Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

Scheduled

Successfully assigned openshift-ingress/e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z to ip-10-0-134-111.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3e24a782-openshift-default-58df774844-lxqrn to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9 to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49 to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9 to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw to ip-10-0-140-142.ec2.internal

openshift-ingress

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-07f2626b-openshift-default-759467867b-2cqwz to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq to ip-10-0-140-142.ec2.internal

openshift-ingress

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k to ip-10-0-131-186.ec2.internal

openshift-ingress

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd to ip-10-0-131-186.ec2.internal

openshift-ingress

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7 to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx to ip-10-0-134-111.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-hrqmq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-hrqmq to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn to ip-10-0-140-142.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2gjdw to ip-10-0-140-142.ec2.internal

openshift-ingress

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52 to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52 to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-gc5jg

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-gc5jg to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5 to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56 to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296 to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4 to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b77bc8-75675867c9-6shms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b77bc8-75675867c9-6shms to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2 to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-h866m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-h866m to ip-10-0-131-186.ec2.internal

openshift-ingress

router-default-6b84465d6d-lbgjn

Scheduled

Successfully assigned openshift-ingress/router-default-6b84465d6d-lbgjn to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4 to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8 to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6 to ip-10-0-140-142.ec2.internal

openshift-ingress

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc to ip-10-0-140-142.ec2.internal

openshift-ingress

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2 to ip-10-0-134-111.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr to ip-10-0-140-142.ec2.internal

openshift-ingress

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4 to ip-10-0-131-186.ec2.internal

openshift-ingress

kube-auth-proxy-b485767cb-wgfwb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b485767cb-wgfwb to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h to ip-10-0-134-111.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-fzs4b

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fzs4b to ip-10-0-131-186.ec2.internal

openshift-ingress

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd to ip-10-0-140-142.ec2.internal

openshift-ingress

kube-auth-proxy-b485767cb-hczf6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b485767cb-hczf6 to ip-10-0-131-186.ec2.internal

openshift-ingress

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9 to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8 to ip-10-0-134-111.ec2.internal

openshift-ingress

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh to ip-10-0-140-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn to ip-10-0-131-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4 to ip-10-0-134-111.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6b84465d6d from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-6b84465d6d

FailedCreate

Error creating: pods "router-default-6b84465d6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6b84465d6d

FailedCreate

Error creating: pods "router-default-6b84465d6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6b84465d6d

SuccessfulCreate

Created pod: router-default-6b84465d6d-lbgjn
(x5)

openshift-ingress

kubelet

router-default-6b84465d6d-lbgjn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6b84465d6d-lbgjn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6b84465d6d-lbgjn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6b84465d6d-lbgjn

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6b84465d6d-lbgjn

Started

Started container router

openshift-ingress

kubelet

router-default-6b84465d6d-lbgjn

Created

Created container: router
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-b485767cb

FailedCreate

Error creating: pods "kube-auth-proxy-b485767cb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-b485767cb-wgfwb

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-hczf6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-b485767cb

SuccessfulCreate

Created pod: kube-auth-proxy-b485767cb-hczf6

openshift-ingress

replicaset-controller

kube-auth-proxy-b485767cb

SuccessfulCreate

Created pod: kube-auth-proxy-b485767cb-wgfwb

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-b485767cb from 0 to 2

openshift-ingress

multus

kube-auth-proxy-b485767cb-hczf6

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-wgfwb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-fzs4b

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-hczf6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.233s (3.233s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-hczf6

Created

Created container: kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-fzs4b

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-hczf6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-wgfwb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fzs4b

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-wgfwb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b485767cb-wgfwb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.195s (3.195s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fzs4b

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.584s (2.584s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fzs4b

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fzs4b

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fzs4b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fzs4b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.869s (2.869s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-lrk7t

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-hrqmq

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hrqmq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hrqmq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hrqmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-hrqmq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-fzs4b

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-fzs4b

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-2gjdw

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.233s (3.234s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-h866m

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-gc5jg

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-h866m

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-h866m

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gc5jg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-gc5jg

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-h866m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-h866m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-h866m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.436s (1.436s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gc5jg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gc5jg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.647s (3.647s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gc5jg

Created

Created container: payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2gjdw

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-553596-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-553596-openshift-default-9c76c7c74 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-553596-openshift-default-9c76c7c74

SuccessfulCreate

Created pod: e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f63893

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f63893

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-d73031

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-d73031

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-553596

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-553596

openshift-ingress

replicaset-controller

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd

SuccessfulCreate

Created pod: e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

openshift-ingress

multus

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-f63893-openshift-default-6d74695c9b

SuccessfulCreate

Created pod: e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

openshift-ingress

deployment-controller

e2e-inf-a-f63893-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f63893-openshift-default-6d74695c9b from 0 to 1

openshift-ingress

multus

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-d73031-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-d73031

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-d73031-6758784df9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d73031: serviceaccount "payload-processing-e2e-worker-w0-d73031" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d73031-6758784df9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d73031-6758784df9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-d73031-6758784df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d73031: serviceaccount "payload-processing-e2e-worker-w0-d73031" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-d73031

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

openshift-ingress

multus

payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-553596

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-553596: serviceaccount "payload-processing-e2e-worker-w4-553596" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn

openshift-ingress

multus

payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-553596-7cfc8b6869

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-553596-7cfc8b6869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-553596: serviceaccount "payload-processing-e2e-worker-w4-553596" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-553596-7cfc8b6869

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-553596

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-553596-7cfc8b6869 from 0 to 1

openshift-ingress

deployment-controller

e2e-autores-89bb6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-89bb6c-openshift-default-574d65997d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.489s (1.489s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-89bb6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-89bb6c

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f63893

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f63893-6c55b6746c from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-89bb6c-openshift-default-574d65997d

SuccessfulCreate

Created pod: e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-2f7a9131-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2f7a9131-openshift-default-6bc949d54d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f63893-6c55b6746c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f63893-6c55b6746c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f63893-6c55b6746c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f63893: serviceaccount "payload-processing-e2e-inf-a-f63893" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-2f7a9131

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2f7a9131

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f63893

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f63893-79bff95d66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f63893-79bff95d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f63893-79bff95d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f63893: serviceaccount "payload-processing-e2e-inf-a-f63893" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f63893-79bff95d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp

openshift-ingress

replicaset-controller

e2e-ait-2f7a9131-openshift-default-6bc949d54d

SuccessfulCreate

Created pod: e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

openshift-ingress

multus

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2f7a9131

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2f7a9131-77ff96c8c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2f7a9131-77ff96c8c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2f7a9131-77ff96c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2f7a9131: serviceaccount "payload-processing-e2e-ait-2f7a9131" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2f7a9131-77ff96c8c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2f7a9131: serviceaccount "payload-processing-e2e-ait-2f7a9131" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw

openshift-ingress

kubelet

payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2f7a9131

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-89bb6c-b765bbff7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-89bb6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-89bb6c-68884df654 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-89bb6c-68884df654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-89bb6c-68884df654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-89bb6c-68884df654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-89bb6c: serviceaccount "payload-processing-e2e-autores-89bb6c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-89bb6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-89bb6c-b765bbff7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-89bb6c-b765bbff7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-89bb6c-b765bbff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-89bb6c: serviceaccount "payload-processing-e2e-autores-89bb6c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-12eb53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-12eb53

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-inf-b-12eb53-openshift-default-d989c5d6d

SuccessfulCreate

Created pod: e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

openshift-ingress

deployment-controller

e2e-inf-b-12eb53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-12eb53-openshift-default-d989c5d6d from 0 to 1

openshift-ingress

multus

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-12eb53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-12eb53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-12eb53-86d9499f79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12eb53-86d9499f79

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-12eb53-86d9499f79

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-12eb53-86d9499f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12eb53: serviceaccount "payload-processing-e2e-inf-b-12eb53" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-12eb53: serviceaccount "payload-processing-e2e-inf-b-12eb53" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-2f7a9131-77ff96c8c-454jn

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2f7a9131-7964d9d4f8-rlrbw

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-migrate-f8c01007-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb from 0 to 1

openshift-ingress

kubelet

e2e-ait-2f7a9131-openshift-default-6bc949d54d-sk4pw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-f8c01007-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f8c01007-gw

openshift-ingress

replicaset-controller

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb

SuccessfulCreate

Created pod: e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

openshift-ingress

multus

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f8c01007

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f8c01007-677cb74fcd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f8c01007

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f8c01007: serviceaccount "payload-processing-e2e-migrate-f8c01007" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f8c01007-677cb74fcd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f8c01007-677cb74fcd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f8c01007-677cb74fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f8c01007: serviceaccount "payload-processing-e2e-migrate-f8c01007" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-f8c01007-677cb74fcd-59ck9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f8c01007-7758f9dfb6-4879p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-ed21d135

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ed21d135

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-f8c01007-gw-openshift-default-6db5545dcb-49d52

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8

SuccessfulCreate

Created pod: e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

openshift-ingress

deployment-controller

e2e-ait-ed21d135-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ed21d135-openshift-default-6cd6cbdfc8 from 0 to 1

openshift-ingress

multus

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ed21d135-5b89f8cc8f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ed21d135-5b89f8cc8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ed21d135: serviceaccount "payload-processing-e2e-ait-ed21d135" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ed21d135

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ed21d135-746d8ccd86 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ed21d135

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ed21d135-5b89f8cc8f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ed21d135-5b89f8cc8f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ed21d135: serviceaccount "payload-processing-e2e-ait-ed21d135" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-ed21d135

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-ed21d135: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-ed21d135": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-ed21d135, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 59671a7e-d5cc-4e8b-bfbe-032b3e195b92, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ed21d135-746d8ccd86-86stx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ed21d135-5b89f8cc8f-9gfb9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ed21d135-openshift-default-6cd6cbdfc8-xz9r7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-23f49f11-openshift-default-564dfff8bd

SuccessfulCreate

Created pod: e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

openshift-ingress

gateway_labeler_controller

e2e-derive-23f49f11

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-23f49f11

openshift-ingress

deployment-controller

e2e-derive-23f49f11-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-23f49f11-openshift-default-564dfff8bd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-23f49f11-b69749d7c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-23f49f11-b69749d7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-23f49f11: serviceaccount "payload-processing-e2e-derive-23f49f11" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-23f49f11-8656bfd986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-23f49f11-8656bfd986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-23f49f11: serviceaccount "payload-processing-e2e-derive-23f49f11" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-23f49f11-8656bfd986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-23f49f11

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-23f49f11-8656bfd986 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-23f49f11-b69749d7c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw

openshift-ingress

deployment-controller

payload-processing-e2e-derive-23f49f11

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-23f49f11-b69749d7c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89bb6c-68884df654-7r6bc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-89bb6c-b765bbff7-q77gb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23f49f11-8656bfd986-4jt52

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-23f49f11-openshift-default-564dfff8bd-xr97d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-23f49f11-b69749d7c-wnznw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-89bb6c-openshift-default-574d65997d-xtzbq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-386ac7-openshift-default-8c45cc8b8

SuccessfulCreate

Created pod: e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

openshift-ingress

deployment-controller

e2e-explicit-386ac7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-386ac7-openshift-default-8c45cc8b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-386ac7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-386ac7

openshift-ingress

multus

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-386ac7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-386ac7-7dbdc767b9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-386ac7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-386ac7-7dbdc767b9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-386ac7-7dbdc767b9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-386ac7-7dbdc767b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-386ac7: serviceaccount "payload-processing-e2e-explicit-386ac7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-386ac7: serviceaccount "payload-processing-e2e-explicit-386ac7" not found

openshift-ingress

multus

payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-386ac7-7dbdc767b9-zw7xf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-386ac7-6d9f54ff4b-sx4lm

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-07f2626b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-07f2626b

openshift-ingress

deployment-controller

e2e-mt-07f2626b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-07f2626b-openshift-default-759467867b from 0 to 1

openshift-ingress

multus

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-07f2626b-openshift-default-759467867b

SuccessfulCreate

Created pod: e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-07f2626b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-07f2626b: serviceaccount "payload-processing-e2e-mt-07f2626b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-07f2626b-557d6bc885

FailedCreate

Error creating: pods "payload-processing-e2e-mt-07f2626b-557d6bc885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-07f2626b: serviceaccount "payload-processing-e2e-mt-07f2626b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-07f2626b-557d6bc885

SuccessfulCreate

Created pod: payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb

openshift-ingress

deployment-controller

payload-processing-e2e-mt-07f2626b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-07f2626b-557d6bc885 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-noten-d33a60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d33a60

openshift-ingress

multus

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-386ac7-openshift-default-8c45cc8b8-rsz8k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-d33a60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d33a60-openshift-default-6576d4dc94 from 0 to 1

openshift-ingress

kubelet

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-d33a60-openshift-default-6576d4dc94

SuccessfulCreate

Created pod: e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

openshift-ingress

kubelet

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": read tcp 10.133.0.2:38132->10.133.0.72:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": read tcp 10.133.0.2:38132->10.133.0.72:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07f2626b-564b5f4f9d-dkfsc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-07f2626b-557d6bc885-gqpsb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-07f2626b-openshift-default-759467867b-2cqwz

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956

SuccessfulCreate

Created pod: e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

openshift-ingress

deployment-controller

e2e-shared-a-w2-a761e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-a761e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-a761e9

openshift-ingress

kubelet

e2e-noten-d33a60-openshift-default-6576d4dc94-t5dnq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a761e9: serviceaccount "payload-processing-e2e-shared-a-w2-a761e9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-a761e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a761e9: serviceaccount "payload-processing-e2e-shared-a-w2-a761e9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-a761e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-6c3180-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-6c3180

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-6c3180

openshift-ingress

replicaset-controller

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4

SuccessfulCreate

Created pod: e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

openshift-ingress

multus

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f63893-6c55b6746c-2g9q8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f63893-79bff95d66-9qcqp

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6c3180: serviceaccount "payload-processing-e2e-shared-b-w2-6c3180" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-6c3180

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-6c3180-755b6c74df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-6c3180

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6c3180: serviceaccount "payload-processing-e2e-shared-b-w2-6c3180" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-f63893-openshift-default-6d74695c9b-2hxfd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-12eb53-86d9499f79-nh5pq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-12eb53-577fc5b8c4-86hb2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-3e24a782-openshift-default-58df774844

SuccessfulCreate

Created pod: e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

openshift-ingress

gateway_labeler_controller

e2e-mt-3e24a782

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3e24a782

openshift-ingress

deployment-controller

e2e-mt-3e24a782-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3e24a782-openshift-default-58df774844 from 0 to 1

openshift-ingress

multus

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76

SuccessfulCreate

Created pod: e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

openshift-ingress

deployment-controller

e2e-shared-a-w3-bf9898-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-bf9898-openshift-default-fc9854c76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-bf9898

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-bf9898

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w3-bf9898

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w3-bf9898-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w3-bf9898-authn-ssl" already exists
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-12eb53-openshift-default-d989c5d6d-hrdff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3e24a782

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3e24a782-748755bf4b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3e24a782-748755bf4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3e24a782-748755bf4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3e24a782: serviceaccount "payload-processing-e2e-mt-3e24a782" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3e24a782-66c756b897

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3e24a782-66c756b897-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3e24a782: serviceaccount "payload-processing-e2e-mt-3e24a782" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3e24a782

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3e24a782-66c756b897 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-bf9898-6789457b87

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-bf9898-6789457b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-bf9898: serviceaccount "payload-processing-e2e-shared-a-w3-bf9898" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3e24a782-748755bf4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-bf9898: serviceaccount "payload-processing-e2e-shared-a-w3-bf9898" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-bf9898

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-bf9898

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-bf9898-6789457b87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-bf9898-6789457b87

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3e24a782-66c756b897

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8

openshift-ingress

multus

payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-5faf38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-5faf38

openshift-ingress

deployment-controller

e2e-shared-b-w3-5faf38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-5faf38-openshift-default-855bf88d44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44

SuccessfulCreate

Created pod: e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5faf38: serviceaccount "payload-processing-e2e-shared-b-w3-5faf38" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-5faf38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-5faf38-577b695bf5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-5faf38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5faf38: serviceaccount "payload-processing-e2e-shared-b-w3-5faf38" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-3e24a782

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-3e24a782: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-3e24a782": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-3e24a782, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 27485dba-5fd3-46d6-bfd0-8cc474b01e3a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e24a782-748755bf4b-4cns4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3e24a782-66c756b897-tf7g8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-3e24a782-openshift-default-58df774844-lxqrn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-1e370a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1e370a

openshift-ingress

deployment-controller

e2e-api-a-1e370a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1e370a-openshift-default-6fc4f7d86b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-1e370a-openshift-default-6fc4f7d86b

SuccessfulCreate

Created pod: e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

openshift-ingress

multus

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1e370a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1e370a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1e370a-5f88dfcd7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1e370a-5f88dfcd7c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1e370a-5f88dfcd7c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1e370a-5f88dfcd7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1e370a: serviceaccount "payload-processing-e2e-api-a-1e370a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1e370a: serviceaccount "payload-processing-e2e-api-a-1e370a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d73031-6758784df9-fg9rh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d73031-5d5b5fd68b-msqq2

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-b77bc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b77bc8

openshift-ingress

deployment-controller

e2e-api-b-b77bc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b77bc8-openshift-default-67d7bc654d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-b77bc8-openshift-default-67d7bc654d

SuccessfulCreate

Created pod: e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-d73031-openshift-default-7dcf8dfcdd-n9pbd

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b77bc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b77bc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b77bc8-75675867c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b77bc8-75675867c9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b77bc8-75675867c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b77bc8: serviceaccount "payload-processing-e2e-api-b-b77bc8" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b77bc8: serviceaccount "payload-processing-e2e-api-b-b77bc8" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b77bc8-75675867c9-6shms

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw

openshift-ingress

kubelet

payload-processing-e2e-api-b-b77bc8-75675867c9-6shms

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b77bc8-75675867c9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b77bc8-75675867c9-6shms

openshift-ingress

kubelet

payload-processing-e2e-api-b-b77bc8-75675867c9-6shms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-b77bc8-75675867c9-6shms

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e370a-5bc569f9cd-2w9pb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e370a-5f88dfcd7c-f8d8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-1e370a-openshift-default-6fc4f7d86b-hcqf5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-b77bc8-75675867c9-6shms

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-b77bc8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-b77bc8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-b77bc8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-b77bc8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 511be1d7-c603-474f-8258-29e10d7c85a3, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b77bc8-74b5fdc466-nm8hw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-553596-f6b86cb4b-nzzsn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-553596-7cfc8b6869-lhhmr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-b77bc8-openshift-default-67d7bc654d-phz7z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-553596-openshift-default-9c76c7c74-pmv9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a761e9-8668c4b86c-g5tnt

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-a761e9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a761e9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-a761e9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a761e9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ac02fbde-14b3-41d9-8752-f863c732a0de, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a761e9-bbc57c58-ncjsb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-a761e9-openshift-default-5fd98bd956-ww78k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c3180-755b6c74df-m5n9h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c3180-567978b4c4-q5v56

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-6c3180-openshift-default-7b969b7cf4-vjcs4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-a-765dd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-765dd1-openshift-default-596d84cc9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-765dd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-765dd1

openshift-ingress

replicaset-controller

e2e-ipp-a-765dd1-openshift-default-596d84cc9b

SuccessfulCreate

Created pod: e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

openshift-ingress

multus

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-765dd1: serviceaccount "payload-processing-e2e-ipp-a-765dd1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-765dd1: serviceaccount "payload-processing-e2e-ipp-a-765dd1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-765dd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-765dd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648

SuccessfulCreate

Created pod: e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9c1a4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9c1a4f

openshift-ingress

deployment-controller

e2e-ipp-b-9c1a4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9c1a4f-openshift-default-6cb5478648 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9c1a4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9c1a4f: serviceaccount "payload-processing-e2e-ipp-b-9c1a4f" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9c1a4f: serviceaccount "payload-processing-e2e-ipp-b-9c1a4f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9c1a4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

Unhealthy

Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

ProbeError

Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-cd2146

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-cd2146

openshift-ingress

deployment-controller

e2e-ipp-cleanup-cd2146-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

openshift-ingress

multus

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-cd2146

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cd2146: serviceaccount "payload-processing-e2e-ipp-cleanup-cd2146" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cd2146: serviceaccount "payload-processing-e2e-ipp-cleanup-cd2146" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-cd2146

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2146-5cd76bc7db-klgm4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2146-6dd5598f67-xwn49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2146-openshift-default-7c5789778d-jzhrc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-765dd1-6ddb8fc66c-z4wxl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-765dd1-7c5586f698-pfrhp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-765dd1-openshift-default-596d84cc9b-bdgdd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c1a4f-94fcf4786-d9w8z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c1a4f-6468fbcb47-h4dlv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-9c1a4f-openshift-default-6cb5478648-7xcd9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-bf9898-6789457b87-c6rm6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-bf9898-54ff665d66-ltkvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-bf9898-openshift-default-fc9854c76-9nmpm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5faf38-577b695bf5-mhcw4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5faf38-688fb5d5f8-xl296

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-5faf38-openshift-default-855bf88d44-rxslw

Killing

Stopping container istio-proxy