Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm to ip-10-0-129-61.ec2.internal

openshift-ingress

router-default-64988bbc7d-tnjdw

Scheduled

Successfully assigned openshift-ingress/router-default-64988bbc7d-tnjdw to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9 to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s to ip-10-0-136-96.ec2.internal

openshift-ingress

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt to ip-10-0-135-35.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-9v8ts

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-9v8ts to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69 to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb to ip-10-0-136-96.ec2.internal

openshift-ingress

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7 to ip-10-0-129-61.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6f28p

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6f28p to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6 to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8 to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4 to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4 to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7 to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54 to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

Scheduled

Successfully assigned openshift-ingress/e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8 to ip-10-0-129-61.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz to ip-10-0-136-96.ec2.internal

openshift-ingress

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-q49w6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-q49w6 to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq to ip-10-0-135-35.ec2.internal

openshift-ingress

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25 to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2 to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm to ip-10-0-136-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2 to ip-10-0-129-61.ec2.internal

openshift-ingress

kube-auth-proxy-7f6f8d7966-fnc7x

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f6f8d7966-fnc7x to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn to ip-10-0-135-35.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ht7f to ip-10-0-129-61.ec2.internal

openshift-ingress

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-975227-openshift-default-77867b86c4-bls4b to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-zk2hb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-zk2hb to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm to ip-10-0-129-61.ec2.internal

openshift-ingress

kube-auth-proxy-7f6f8d7966-tzrvk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f6f8d7966-tzrvk to ip-10-0-135-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877 to ip-10-0-129-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr to ip-10-0-129-61.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-64988bbc7d from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-64988bbc7d

FailedCreate

Error creating: pods "router-default-64988bbc7d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-64988bbc7d

FailedCreate

Error creating: pods "router-default-64988bbc7d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-64988bbc7d

SuccessfulCreate

Created pod: router-default-64988bbc7d-tnjdw
(x6)

openshift-ingress

kubelet

router-default-64988bbc7d-tnjdw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-64988bbc7d-tnjdw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-64988bbc7d-tnjdw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-64988bbc7d-tnjdw

Started

Started container router

openshift-ingress

multus

router-default-64988bbc7d-tnjdw

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-64988bbc7d-tnjdw

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-7f6f8d7966

SuccessfulCreate

Created pod: kube-auth-proxy-7f6f8d7966-fnc7x
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7f6f8d7966

FailedCreate

Error creating: pods "kube-auth-proxy-7f6f8d7966-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7f6f8d7966 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-7f6f8d7966-fnc7x

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7f6f8d7966

SuccessfulCreate

Created pod: kube-auth-proxy-7f6f8d7966-tzrvk

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-tzrvk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-fnc7x

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7f6f8d7966-tzrvk

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6f28p

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6f28p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6f28p

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-fnc7x

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-tzrvk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-tzrvk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.499s (2.499s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-tzrvk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-fnc7x

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f6f8d7966-fnc7x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.549s (2.549s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6f28p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.363s (2.363s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6f28p

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6f28p

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6f28p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6f28p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.433s (2.433s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vd8kz

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-9v8ts

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9v8ts

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-9v8ts

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9v8ts

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9v8ts

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.6s (2.6s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9v8ts

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6f28p

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6f28p

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-2ht7f

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.603s (2.603s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-q49w6

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-zk2hb

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-q49w6

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zk2hb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q49w6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-zk2hb

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q49w6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q49w6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.125s (3.125s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zk2hb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zk2hb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zk2hb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.094s (3.094s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q49w6

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

ProbeError

Startup probe error: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2ht7f

Unhealthy

Startup probe failed: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-bc851d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-bc851d-openshift-default-86c8786974 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-b3d6c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-b3d6c5

openshift-ingress

multus

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-bc851d-openshift-default-86c8786974

SuccessfulCreate

Created pod: e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

openshift-ingress

multus

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-975227-openshift-default-77867b86c4

SuccessfulCreate

Created pod: e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

openshift-ingress

deployment-controller

e2e-inf-a-975227-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-975227-openshift-default-77867b86c4 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-b3d6c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b3d6c5-openshift-default-6b77695f78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78

SuccessfulCreate

Created pod: e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-bc851d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-bc851d

openshift-ingress

gateway_labeler_controller

e2e-inf-a-975227

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-975227

openshift-ingress

multus

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-bc851d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-bc851d-5644dcddc7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-bc851d-5644dcddc7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-bc851d-5644dcddc7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-bc851d-5644dcddc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-bc851d: serviceaccount "payload-processing-e2e-worker-w0-bc851d" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-bc851d: serviceaccount "payload-processing-e2e-worker-w0-bc851d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-bc851d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b3d6c5-678f6d565

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n

openshift-ingress

multus

payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-b3d6c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b3d6c5: serviceaccount "payload-processing-e2e-worker-w4-b3d6c5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b3d6c5-678f6d565

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-b3d6c5-678f6d565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b3d6c5: serviceaccount "payload-processing-e2e-worker-w4-b3d6c5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-b3d6c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-b3d6c5-678f6d565 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-975227

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-975227-79cf86b4b9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-975227-544d759b7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-975227-544d759b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-975227: serviceaccount "payload-processing-e2e-inf-a-975227" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-975227

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-975227-544d759b7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-975227-544d759b7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-975227-79cf86b4b9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-975227-79cf86b4b9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-975227-79cf86b4b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-975227: serviceaccount "payload-processing-e2e-inf-a-975227" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-c14a5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-c14a5e

openshift-ingress

deployment-controller

e2e-autores-c14a5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-c14a5e-openshift-default-685d7c8f76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-c14a5e-openshift-default-685d7c8f76

SuccessfulCreate

Created pod: e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

openshift-ingress

kubelet

payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.323s (1.323s including waiting). Image size: 166449312 bytes.

openshift-ingress

multus

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.299s (1.299s including waiting). Image size: 166449312 bytes.

openshift-ingress

gateway_labeler_controller

e2e-ait-360610b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-360610b9

openshift-ingress

multus

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-360610b9-openshift-default-68cf9f49bb

SuccessfulCreate

Created pod: e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

openshift-ingress

deployment-controller

e2e-ait-360610b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-360610b9-openshift-default-68cf9f49bb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-360610b9-dcdbfcb7c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-360610b9-dcdbfcb7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-360610b9: serviceaccount "payload-processing-e2e-ait-360610b9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-360610b9-dcdbfcb7c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms

openshift-ingress

deployment-controller

payload-processing-e2e-ait-360610b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-360610b9-dcdbfcb7c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-360610b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-360610b9: serviceaccount "payload-processing-e2e-ait-360610b9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-c14a5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-c14a5e-5bddbc7695 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c14a5e: serviceaccount "payload-processing-e2e-autores-c14a5e" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c14a5e-5bddbc7695

FailedCreate

Error creating: pods "payload-processing-e2e-autores-c14a5e-5bddbc7695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c14a5e: serviceaccount "payload-processing-e2e-autores-c14a5e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-c14a5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-inf-b-cadd9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-cadd9c-openshift-default-7df5ccf54d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-cadd9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-cadd9c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c14a5e-5bddbc7695

SuccessfulCreate

Created pod: payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d

SuccessfulCreate

Created pod: e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

openshift-ingress

multus

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cadd9c: serviceaccount "payload-processing-e2e-inf-b-cadd9c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cadd9c: serviceaccount "payload-processing-e2e-inf-b-cadd9c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-cadd9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-cadd9c-6d6875cb5f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-cadd9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-360610b9-d7d9f7c8b-h9fng

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-360610b9-dcdbfcb7c-x6rms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-360610b9-openshift-default-68cf9f49bb-8fnmh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584

SuccessfulCreate

Created pod: e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

openshift-ingress

gateway_labeler_controller

e2e-migrate-ea32f836-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-ea32f836-gw

openshift-ingress

deployment-controller

e2e-migrate-ea32f836-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-ea32f836-gw-openshift-default-747c4f4584 from 0 to 1

openshift-ingress

multus

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ea32f836-5564f99954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-ea32f836-5564f99954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ea32f836: serviceaccount "payload-processing-e2e-migrate-ea32f836" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ea32f836-5564f99954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ea32f836-c5d6f4454

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-ea32f836-c5d6f4454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ea32f836: serviceaccount "payload-processing-e2e-migrate-ea32f836" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ea32f836-c5d6f4454

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-ea32f836

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-ea32f836-5564f99954 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-ea32f836

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-ea32f836-c5d6f4454 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-ea32f836-gw-openshift-default-747c4f4584-6m8n7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ea32f836-5564f99954-9b4rx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-ea32f836-c5d6f4454-sjgzp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-dd15e28a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-dd15e28a-openshift-default-59f89bb656 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-dd15e28a-openshift-default-59f89bb656

SuccessfulCreate

Created pod: e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

openshift-ingress

multus

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-dd15e28a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-dd15e28a

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-dd15e28a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-dd15e28a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-dd15e28a-85f8649f55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dd15e28a-85f8649f55

FailedCreate

Error creating: pods "payload-processing-e2e-ait-dd15e28a-85f8649f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dd15e28a: serviceaccount "payload-processing-e2e-ait-dd15e28a" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dd15e28a: serviceaccount "payload-processing-e2e-ait-dd15e28a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dd15e28a-85f8649f55

SuccessfulCreate

Created pod: payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt

openshift-ingress

kubelet

payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dd15e28a-6d4cdb9cf4-6m4dm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-dd15e28a-85f8649f55-tg5xt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-dd15e28a-openshift-default-59f89bb656-bqcl6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-3448586b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3448586b-openshift-default-68cf5c59bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-3448586b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3448586b

openshift-ingress

replicaset-controller

e2e-derive-3448586b-openshift-default-68cf5c59bd

SuccessfulCreate

Created pod: e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

openshift-ingress

multus

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3448586b-74b69d6dfc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3448586b-74b69d6dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3448586b: serviceaccount "payload-processing-e2e-derive-3448586b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3448586b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3448586b-74b69d6dfc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3448586b-7c9c885c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3448586b-7c9c885c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3448586b: serviceaccount "payload-processing-e2e-derive-3448586b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3448586b-7c9c885c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3448586b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3448586b-7c9c885c74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3448586b-74b69d6dfc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842

openshift-ingress

kubelet

payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-c14a5e-5bddbc7695-f7hfv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c14a5e-7c54bdfbb-9x5ns

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3448586b-7c9c885c74-scz69

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3448586b-74b69d6dfc-l2842

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-3448586b-openshift-default-68cf5c59bd-gkvhr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-c14a5e-openshift-default-685d7c8f76-8k6hq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-ace1c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ace1c6

openshift-ingress

replicaset-controller

e2e-explicit-ace1c6-openshift-default-87545cf7b

SuccessfulCreate

Created pod: e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

openshift-ingress

deployment-controller

e2e-explicit-ace1c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ace1c6-openshift-default-87545cf7b from 0 to 1

openshift-ingress

multus

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ace1c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ace1c6-5f5665f86f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ace1c6-5f5665f86f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ace1c6-5f5665f86f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ace1c6: serviceaccount "payload-processing-e2e-explicit-ace1c6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ace1c6-5f5665f86f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ace1c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ace1c6-df7b95966 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ace1c6-df7b95966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ace1c6-df7b95966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ace1c6-df7b95966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ace1c6: serviceaccount "payload-processing-e2e-explicit-ace1c6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-758ecaaa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-758ecaaa

openshift-ingress

replicaset-controller

e2e-mt-758ecaaa-openshift-default-7558f79656

SuccessfulCreate

Created pod: e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

openshift-ingress

multus

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-758ecaaa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-758ecaaa-openshift-default-7558f79656 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-758ecaaa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-758ecaaa-77bdd8df7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-758ecaaa-77bdd8df7c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-758ecaaa-77bdd8df7c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-758ecaaa-77bdd8df7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-758ecaaa: serviceaccount "payload-processing-e2e-mt-758ecaaa" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-758ecaaa: serviceaccount "payload-processing-e2e-mt-758ecaaa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-758ecaaa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-758ecaaa-5d4f695698 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-758ecaaa-5d4f695698-gtf25

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-758ecaaa-77bdd8df7c-mqps2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-758ecaaa-openshift-default-7558f79656-6bwmm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-31063a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-31063a

openshift-ingress

replicaset-controller

e2e-shared-a-w2-31063a-openshift-default-d976fc474

SuccessfulCreate

Created pod: e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

openshift-ingress

deployment-controller

e2e-shared-a-w2-31063a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-31063a-openshift-default-d976fc474 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-ace1c6-5f5665f86f-xsxln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ace1c6-df7b95966-ddphl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-31063a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-31063a: serviceaccount "payload-processing-e2e-shared-a-w2-31063a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-31063a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-31063a-7f465569c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-31063a-7f465569c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-31063a-7f465569c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-31063a-7f465569c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-31063a: serviceaccount "payload-processing-e2e-shared-a-w2-31063a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b8be88

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b8be88

openshift-ingress

deployment-controller

e2e-shared-b-w2-b8be88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb

SuccessfulCreate

Created pod: e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

openshift-ingress

multus

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b8be88

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b8be88

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b8be88: serviceaccount "payload-processing-e2e-shared-b-w2-b8be88" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b8be88: serviceaccount "payload-processing-e2e-shared-b-w2-b8be88" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb

openshift-ingress

kubelet

payload-processing-e2e-inf-a-975227-79cf86b4b9-2rk8q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-975227-544d759b7d-c8k54

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb

Started

Started container payload-processing
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-4c0b93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-4c0b93

openshift-ingress

kubelet

e2e-inf-a-975227-openshift-default-77867b86c4-bls4b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-4c0b93-openshift-default-574684cd66

SuccessfulCreate

Created pod: e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

openshift-ingress

deployment-controller

e2e-noten-4c0b93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-4c0b93-openshift-default-574684cd66 from 0 to 1

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-ace1c6-openshift-default-87545cf7b-gdfjq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cadd9c-6d6875cb5f-qs9x9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cadd9c-6b465f888b-w295q

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-336ccc18-openshift-default-b45ffcd9b

SuccessfulCreate

Created pod: e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

openshift-ingress

gateway_labeler_controller

e2e-mt-336ccc18

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-336ccc18

openshift-ingress

deployment-controller

e2e-mt-336ccc18-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-336ccc18-openshift-default-b45ffcd9b from 0 to 1

openshift-ingress

multus

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-336ccc18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-336ccc18-7f494f8ffc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-336ccc18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-336ccc18-6f675b7498 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-336ccc18-7f494f8ffc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-336ccc18-7f494f8ffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-336ccc18: serviceaccount "payload-processing-e2e-mt-336ccc18" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-336ccc18-7f494f8ffc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-336ccc18-6f675b7498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-336ccc18-6f675b7498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-336ccc18: serviceaccount "payload-processing-e2e-mt-336ccc18" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-336ccc18-6f675b7498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8

SuccessfulCreate

Created pod: e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

openshift-ingress

kubelet

e2e-inf-b-cadd9c-openshift-default-7df5ccf54d-vqjp2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-14f3af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-14f3af

openshift-ingress

deployment-controller

e2e-shared-a-w3-14f3af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-14f3af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-14f3af-54b866949c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-14f3af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-14f3af-54b866949c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-14f3af: serviceaccount "payload-processing-e2e-shared-a-w3-14f3af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-14f3af-54b866949c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-14f3af-54b866949c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-14f3af: serviceaccount "payload-processing-e2e-shared-a-w3-14f3af" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-eff5e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-eff5e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-eff5e8

openshift-ingress

replicaset-controller

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d

SuccessfulCreate

Created pod: e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

openshift-ingress

multus

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

ProbeError

Readiness probe error: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Unhealthy

Readiness probe failed: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-eff5e8: serviceaccount "payload-processing-e2e-shared-b-w3-eff5e8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-eff5e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-eff5e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-eff5e8: serviceaccount "payload-processing-e2e-shared-b-w3-eff5e8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-4c0b93-openshift-default-574684cd66-nh8gs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-336ccc18-7f494f8ffc-x4bhv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-336ccc18-6f675b7498-fjpkq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-336ccc18-openshift-default-b45ffcd9b-zgwmb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc851d-5644dcddc7-tdfn4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc851d-7bb95dbff4-fz877

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3d6c5-7945f5bf78-qk8kr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3d6c5-678f6d565-vgm8n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-bc851d-openshift-default-86c8786974-47jml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b3d6c5-openshift-default-6b77695f78-hnlm7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-622b87-openshift-default-78c7bd45bb

SuccessfulCreate

Created pod: e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

openshift-ingress

gateway_labeler_controller

e2e-api-a-622b87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-622b87

openshift-ingress

deployment-controller

e2e-api-a-622b87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-622b87-openshift-default-78c7bd45bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-622b87-784b8d8f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-622b87-784b8d8f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-622b87: serviceaccount "payload-processing-e2e-api-a-622b87" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-622b87-784b8d8f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-622b87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-622b87-784b8d8f78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-622b87-788c7f5f57

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-622b87-788c7f5f57

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-622b87-788c7f5f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-622b87: serviceaccount "payload-processing-e2e-api-a-622b87" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-622b87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-622b87-788c7f5f57 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-1cf25e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1cf25e-openshift-default-7479f9bfbb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-1cf25e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1cf25e

openshift-ingress

replicaset-controller

e2e-api-b-1cf25e-openshift-default-7479f9bfbb

SuccessfulCreate

Created pod: e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

openshift-ingress

multus

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1cf25e-85f7554477

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1cf25e-85f7554477

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1cf25e-85f7554477-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1cf25e: serviceaccount "payload-processing-e2e-api-b-1cf25e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1cf25e: serviceaccount "payload-processing-e2e-api-b-1cf25e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1cf25e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1cf25e-747bc8695d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1cf25e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1cf25e-85f7554477 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-622b87-788c7f5f57-55vd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-622b87-784b8d8f78-vx9qt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-622b87-openshift-default-78c7bd45bb-dhptd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-1cf25e-85f7554477-kvllv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1cf25e-747bc8695d-lhj8j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-1cf25e-openshift-default-7479f9bfbb-cjbz8

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-31063a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-31063a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-31063a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-31063a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2efb0247-c585-4fb3-800f-bb14482cd8b0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-31063a-84bc48cf5d-g6mh2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-31063a-7f465569c-j5dt9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-31063a-openshift-default-d976fc474-8ngzw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-b8be88

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8be88: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-b8be88": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8be88, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bb804fc0-41da-4b98-8438-e553ae660d69, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b8be88-5d65b99d5c-vs8pb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b8be88-5d9bbf6b98-6m2j7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b8be88-openshift-default-764ffd8cbb-gbql7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c87a95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c87a95

openshift-ingress

deployment-controller

e2e-ipp-a-c87a95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c87a95-openshift-default-7656478d8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-c87a95-openshift-default-7656478d8d

SuccessfulCreate

Created pod: e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

openshift-ingress

multus

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c87a95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c87a95-75787d7c55 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c87a95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c87a95: serviceaccount "payload-processing-e2e-ipp-a-c87a95" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c87a95-75787d7c55

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c87a95-75787d7c55

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c87a95-75787d7c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c87a95: serviceaccount "payload-processing-e2e-ipp-a-c87a95" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-27ae76

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-27ae76

openshift-ingress

deployment-controller

e2e-ipp-b-27ae76-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-27ae76-openshift-default-66974cc44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-27ae76-openshift-default-66974cc44

SuccessfulCreate

Created pod: e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

openshift-ingress

multus

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-27ae76

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-27ae76-6f7f7cb887 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-27ae76

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-27ae76: serviceaccount "payload-processing-e2e-ipp-b-27ae76" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-27ae76: serviceaccount "payload-processing-e2e-ipp-b-27ae76" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8e2f31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8e2f31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8e2f31

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

openshift-ingress

multus

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8e2f31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8e2f31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8e2f31: serviceaccount "payload-processing-e2e-ipp-cleanup-8e2f31" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8e2f31: serviceaccount "payload-processing-e2e-ipp-cleanup-8e2f31" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e2f31-5f66649d5c-n2sj4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e2f31-5bc4dc69c4-hftdg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-8e2f31-openshift-default-6dc5c6fb6b-mtj8s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c87a95-75787d7c55-ttbc8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c87a95-6f9bdb7b78-q6584

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-c87a95-openshift-default-7656478d8d-btv4k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-27ae76-65d4b46858-7b66t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-27ae76-6f7f7cb887-tsvkr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-27ae76-openshift-default-66974cc44-x5b6q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-14f3af-58c4d659db-nldwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-14f3af-54b866949c-7zxcw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-14f3af-openshift-default-68c8c577c8-w6t8j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-eff5e8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-eff5e8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-eff5e8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-eff5e8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2bb46425-2f5d-4452-ae4f-0dcb08f50784, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-eff5e8-6c9f9b4df4-9slsm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-eff5e8-558c9dbc79-2qbkv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-eff5e8-openshift-default-bfb7c786d-vwwqm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)