Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5 to ip-10-0-140-26.ec2.internal

openshift-ingress

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Scheduled

Successfully assigned openshift-ingress/e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr

Scheduled

Successfully assigned openshift-ingress/e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr to ip-10-0-134-251.ec2.internal

openshift-ingress

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd to ip-10-0-134-251.ec2.internal

openshift-ingress

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79 to ip-10-0-134-251.ec2.internal

openshift-ingress

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5 to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-965746-dc45866d5-j5wlw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-965746-dc45866d5-j5wlw to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd to ip-10-0-140-26.ec2.internal

openshift-ingress

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8 to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg to ip-10-0-134-251.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-czckm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-czckm to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5 to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p to ip-10-0-134-251.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-txxhf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-txxhf to ip-10-0-134-251.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-6qkth

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-6qkth to ip-10-0-134-251.ec2.internal

openshift-ingress

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ffda9270-openshift-default-744696f866-6g7qx to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc to ip-10-0-134-251.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wf9s5 to ip-10-0-134-251.ec2.internal

openshift-ingress

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7 to ip-10-0-134-251.ec2.internal

openshift-ingress

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-s6mvc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-s6mvc to ip-10-0-132-43.ec2.internal

openshift-ingress

kube-auth-proxy-54b8878898-mdqxh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-54b8878898-mdqxh to ip-10-0-134-251.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k to ip-10-0-134-251.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7 to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl to ip-10-0-134-251.ec2.internal

openshift-ingress

kube-auth-proxy-54b8878898-fz9t7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-54b8878898-fz9t7 to ip-10-0-140-26.ec2.internal

openshift-ingress

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt to ip-10-0-134-251.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n to ip-10-0-140-26.ec2.internal

openshift-ingress

router-default-5cb4f5599b-zzlp9

Scheduled

Successfully assigned openshift-ingress/router-default-5cb4f5599b-zzlp9 to ip-10-0-140-26.ec2.internal

openshift-ingress

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr to ip-10-0-134-251.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44 to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

Scheduled

Successfully assigned openshift-ingress/e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf to ip-10-0-134-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6 to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4 to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh to ip-10-0-132-43.ec2.internal

openshift-ingress

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq to ip-10-0-134-251.ec2.internal

openshift-ingress

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6 to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx to ip-10-0-132-43.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n to ip-10-0-140-26.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs to ip-10-0-140-26.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5cb4f5599b from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-5cb4f5599b

FailedCreate

Error creating: pods "router-default-5cb4f5599b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5cb4f5599b

SuccessfulCreate

Created pod: router-default-5cb4f5599b-zzlp9
(x5)

openshift-ingress

kubelet

router-default-5cb4f5599b-zzlp9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5cb4f5599b-zzlp9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5cb4f5599b-zzlp9

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5cb4f5599b-zzlp9

Created

Created container: router

openshift-ingress

kubelet

router-default-5cb4f5599b-zzlp9

Started

Started container router

openshift-ingress

kubelet

router-default-5cb4f5599b-zzlp9

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-54b8878898 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-fz9t7

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-54b8878898

FailedCreate

Error creating: pods "kube-auth-proxy-54b8878898-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-54b8878898

SuccessfulCreate

Created pod: kube-auth-proxy-54b8878898-fz9t7

openshift-ingress

replicaset-controller

kube-auth-proxy-54b8878898

SuccessfulCreate

Created pod: kube-auth-proxy-54b8878898-mdqxh

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-mdqxh

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txxhf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

kube-auth-proxy-54b8878898-mdqxh

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-fz9t7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-54b8878898-fz9t7

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-mdqxh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-txxhf

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-txxhf

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-fz9t7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.039s (3.04s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-mdqxh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-fz9t7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-fz9t7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-mdqxh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.915s (2.915s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-54b8878898-mdqxh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txxhf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 8.989s (8.989s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txxhf

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txxhf

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rrm2z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.04s (5.04s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-czckm

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-czckm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-czckm

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-czckm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.599s (2.599s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-czckm

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-czckm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-czckm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-czckm

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-txxhf

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-txxhf

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-wf9s5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.856s (3.856s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-s6mvc

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-6qkth
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s6mvc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-6qkth

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-s6mvc

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6qkth

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s6mvc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s6mvc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.722s (1.722s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s6mvc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6qkth

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6qkth

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6qkth

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.491s (2.491s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wf9s5

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-52ba8b-openshift-default-65dddd68cd

SuccessfulCreate

Created pod: e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

openshift-ingress

deployment-controller

e2e-inf-a-52ba8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-52ba8b-openshift-default-65dddd68cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-52ba8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-52ba8b

openshift-ingress

multus

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-52ba8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-52ba8b-6f8f474677

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-52ba8b-6f8f474677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-52ba8b: serviceaccount "payload-processing-e2e-inf-a-52ba8b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-52ba8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-52ba8b-6f8f474677 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-52ba8b: serviceaccount "payload-processing-e2e-inf-a-52ba8b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-52ba8b-6f8f474677

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-ffda9270

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ffda9270

openshift-ingress

replicaset-controller

e2e-ait-ffda9270-openshift-default-744696f866

SuccessfulCreate

Created pod: e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

openshift-ingress

multus

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-ffda9270-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ffda9270-openshift-default-744696f866 from 0 to 1

openshift-ingress

deployment-controller

e2e-autores-235f65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-235f65-openshift-default-79f865dcfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-235f65-openshift-default-79f865dcfb

SuccessfulCreate

Created pod: e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

openshift-ingress

gateway_labeler_controller

e2e-autores-235f65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-235f65

openshift-ingress

multus

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ffda9270: serviceaccount "payload-processing-e2e-ait-ffda9270" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ffda9270-68cd44d7df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ffda9270

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ffda9270-68cd44d7df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ffda9270-68cd44d7df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ffda9270-68cd44d7df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ffda9270: serviceaccount "payload-processing-e2e-ait-ffda9270" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ffda9270

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

openshift-ingress

kubelet

payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-235f65-598b4d8c86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-235f65-598b4d8c86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-235f65-598b4d8c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-235f65: serviceaccount "payload-processing-e2e-autores-235f65" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-235f65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-235f65-598b4d8c86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-235f65-5d5f4c9bb7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.614s (2.614s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-235f65-5d5f4c9bb7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-235f65-5d5f4c9bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-235f65: serviceaccount "payload-processing-e2e-autores-235f65" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-235f65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-235f65-5d5f4c9bb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": read tcp 10.134.0.2:57648->10.134.0.47:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": read tcp 10.134.0.2:57648->10.134.0.47:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-9c3074-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9c3074-openshift-default-6ff985b7fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-9c3074-openshift-default-6ff985b7fb

SuccessfulCreate

Created pod: e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9c3074

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9c3074

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9c3074

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9c3074-d8c48c786 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9c3074-5cb96bf56c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9c3074-5cb96bf56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9c3074: serviceaccount "payload-processing-e2e-inf-b-9c3074" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9c3074: serviceaccount "payload-processing-e2e-inf-b-9c3074" not found
(x6)

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9c3074

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9c3074-5cb96bf56c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9c3074-5cb96bf56c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": read tcp 10.133.0.2:38036->10.133.0.52:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": read tcp 10.133.0.2:38036->10.133.0.52:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-ffda9270-68cd44d7df-bkbbt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ffda9270-openshift-default-744696f866-6g7qx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ffda9270-6fc9b7d7cd-j8s6n

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-migrate-62eb1773-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-62eb1773-gw-openshift-default-76fc489df6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6

SuccessfulCreate

Created pod: e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

openshift-ingress

gateway_labeler_controller

e2e-migrate-62eb1773-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-62eb1773-gw

openshift-ingress

multus

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-62eb1773-77b9549758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-62eb1773-77b9549758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-62eb1773: serviceaccount "payload-processing-e2e-migrate-62eb1773" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-62eb1773

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-62eb1773-5cc66d9bf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-62eb1773-77b9549758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-62eb1773

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-62eb1773-77b9549758 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-62eb1773: serviceaccount "payload-processing-e2e-migrate-62eb1773" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-62eb1773-77b9549758-djwtz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-62eb1773-gw-openshift-default-76fc489df6-dtfjh

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-62eb1773

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-62eb1773: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-62eb1773": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-62eb1773, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eb69a80e-c1a0-4e71-8439-b0a383e5e906, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-62eb1773-5cc66d9bf4-q8w6n

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-a6830f31-openshift-default-569c658bd4

SuccessfulCreate

Created pod: e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

openshift-ingress

gateway_labeler_controller

e2e-ait-a6830f31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a6830f31

openshift-ingress

deployment-controller

e2e-ait-a6830f31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a6830f31-openshift-default-569c658bd4 from 0 to 1

openshift-ingress

multus

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a6830f31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a6830f31-6547848d94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a6830f31-7cfc7449cf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a6830f31-7cfc7449cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a6830f31: serviceaccount "payload-processing-e2e-ait-a6830f31" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a6830f31-6547848d94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a6830f31-6547848d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a6830f31: serviceaccount "payload-processing-e2e-ait-a6830f31" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a6830f31-6547848d94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a6830f31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a6830f31-7cfc7449cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a6830f31-7cfc7449cf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx

openshift-ingress

multus

payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:53790->10.134.0.55:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:53790->10.134.0.55:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-a6830f31

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-a6830f31: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-a6830f31": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-a6830f31, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f9f9d58d-e286-4bda-940f-1179fcaf1787, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6830f31-6547848d94-2pnxs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a6830f31-7cfc7449cf-ntzpx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-a6830f31-openshift-default-569c658bd4-p57ss

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-6956efcb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6956efcb

openshift-ingress

deployment-controller

e2e-derive-6956efcb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6956efcb-openshift-default-647dcfc5b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-6956efcb-openshift-default-647dcfc5b4

SuccessfulCreate

Created pod: e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

openshift-ingress

multus

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6956efcb-6497486db5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6956efcb-6497486db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6956efcb: serviceaccount "payload-processing-e2e-derive-6956efcb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6956efcb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6956efcb-6497486db5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6956efcb-6497486db5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6956efcb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6956efcb-5886645c78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6956efcb-5886645c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4

openshift-ingress

multus

payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6956efcb-5886645c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6956efcb-5886645c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6956efcb: serviceaccount "payload-processing-e2e-derive-6956efcb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-235f65-598b4d8c86-2pckh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-235f65-5d5f4c9bb7-wjzn5

Unhealthy

Readiness probe failed: dial tcp 10.132.0.34:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-6956efcb-6497486db5-hkhpb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6956efcb-5886645c78-4blg4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-6956efcb-openshift-default-647dcfc5b4-qbqbm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-235f65-openshift-default-79f865dcfb-rmcgf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-72dcc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-72dcc3

openshift-ingress

replicaset-controller

e2e-explicit-72dcc3-openshift-default-746d98d88

SuccessfulCreate

Created pod: e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

openshift-ingress

deployment-controller

e2e-explicit-72dcc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-72dcc3-openshift-default-746d98d88 from 0 to 1

openshift-ingress

multus

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-72dcc3-77bb845c7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n

openshift-ingress

multus

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-72dcc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-72dcc3-77bb845c7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-72dcc3-77bb845c7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-72dcc3-77bb845c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-72dcc3: serviceaccount "payload-processing-e2e-explicit-72dcc3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-72dcc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-72dcc3: serviceaccount "payload-processing-e2e-explicit-72dcc3" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-72dcc3-77bb845c7-8vx5n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-72dcc3-7b8976dc86-84lz6

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-72dcc3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-72dcc3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-72dcc3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-72dcc3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aaeccf9f-82a2-4b36-824f-ce9fcdd1c431, UID in object meta:

openshift-ingress

kubelet

e2e-explicit-72dcc3-openshift-default-746d98d88-btm7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-noten-3b2d3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-3b2d3e-openshift-default-5d57487bcd from 0 to 1

openshift-ingress

kubelet

e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-3b2d3e-openshift-default-5d57487bcd

SuccessfulCreate

Created pod: e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr

openshift-ingress

multus

e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-3b2d3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-3b2d3e

openshift-ingress

kubelet

e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-3b2d3e-openshift-default-5d57487bcd-ljvdr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-64effff4-openshift-default-6fc8c75fd8

SuccessfulCreate

Created pod: e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

openshift-ingress

deployment-controller

e2e-mt-64effff4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-64effff4-openshift-default-6fc8c75fd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-64effff4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-64effff4

openshift-ingress

multus

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-64effff4-84f89f7d9c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-64effff4-84f89f7d9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-64effff4: serviceaccount "payload-processing-e2e-mt-64effff4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-64effff4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-64effff4-74fffd9878 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-64effff4-74fffd9878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z

openshift-ingress

deployment-controller

payload-processing-e2e-mt-64effff4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-64effff4-84f89f7d9c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-64effff4-74fffd9878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-64effff4-74fffd9878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-64effff4: serviceaccount "payload-processing-e2e-mt-64effff4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-64effff4-84f89f7d9c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd

openshift-ingress

kubelet

payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-52ba8b-b99f884c4-8fwzw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-52ba8b-6f8f474677-8lj4w

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-52ba8b-openshift-default-65dddd68cd-cczcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3074-5cb96bf56c-n459j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3074-d8c48c786-jlg44

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-64effff4-84f89f7d9c-lkfrd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-64effff4-74fffd9878-7vk8z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-a4001b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-a4001b

openshift-ingress

deployment-controller

e2e-shared-a-w3-a4001b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d

SuccessfulCreate

Created pod: e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

openshift-ingress

multus

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-9c3074-openshift-default-6ff985b7fb-zlcl7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a4001b: serviceaccount "payload-processing-e2e-shared-a-w3-a4001b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-a4001b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a4001b: serviceaccount "payload-processing-e2e-shared-a-w3-a4001b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-a4001b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-64effff4-openshift-default-6fc8c75fd8-c8g7s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-093570-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-093570-openshift-default-5f8745c4db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-093570

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-093570

openshift-ingress

replicaset-controller

e2e-shared-a-w2-093570-openshift-default-5f8745c4db

SuccessfulCreate

Created pod: e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

openshift-ingress

multus

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-093570: serviceaccount "payload-processing-e2e-shared-a-w2-093570" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-093570

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-093570-5df66bf465 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-093570-5df66bf465

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-093570-5df66bf465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-093570: serviceaccount "payload-processing-e2e-shared-a-w2-093570" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-093570

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-093570-5df66bf465

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-525196

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-525196

openshift-ingress

deployment-controller

e2e-shared-b-w3-525196-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-525196-openshift-default-57c99fb76b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-525196-openshift-default-57c99fb76b

SuccessfulCreate

Created pod: e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

openshift-ingress

multus

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-525196

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-525196-55769cf64f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-525196

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-525196-55769cf64f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-525196-55769cf64f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-525196: serviceaccount "payload-processing-e2e-shared-b-w3-525196" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-525196-55769cf64f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-525196: serviceaccount "payload-processing-e2e-shared-b-w3-525196" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb

SuccessfulCreate

Created pod: e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

openshift-ingress

deployment-controller

e2e-shared-b-w2-c6f2ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-c6f2ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-c6f2ed

openshift-ingress

multus

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-c6f2ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c6f2ed: serviceaccount "payload-processing-e2e-shared-b-w2-c6f2ed" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-c6f2ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c6f2ed: serviceaccount "payload-processing-e2e-shared-b-w2-c6f2ed" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-3adca991-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3adca991-openshift-default-d6c4bf448 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-3adca991

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3adca991

openshift-ingress

replicaset-controller

e2e-mt-3adca991-openshift-default-d6c4bf448

SuccessfulCreate

Created pod: e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

openshift-ingress

multus

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3adca991-778ddd6c5c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3adca991-778ddd6c5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3adca991: serviceaccount "payload-processing-e2e-mt-3adca991" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3adca991-778ddd6c5c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3adca991-56dcd68b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3adca991-56dcd68b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3adca991: serviceaccount "payload-processing-e2e-mt-3adca991" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3adca991-56dcd68b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3adca991

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3adca991-778ddd6c5c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3adca991

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3adca991-56dcd68b66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3adca991-56dcd68b66-rlq7k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3adca991-778ddd6c5c-28wp5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-3adca991-openshift-default-d6c4bf448-h2ttl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-a-965746-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-965746-openshift-default-c64dc8db6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-965746

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-965746

openshift-ingress

replicaset-controller

e2e-api-a-965746-openshift-default-c64dc8db6

SuccessfulCreate

Created pod: e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

openshift-ingress

multus

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-965746-dc45866d5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-965746-dc45866d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-965746: serviceaccount "payload-processing-e2e-api-a-965746" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-965746-5df68cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-965746-5df68cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-965746: serviceaccount "payload-processing-e2e-api-a-965746" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-965746

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-965746-5df68cfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-965746-5df68cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-965746

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-965746-dc45866d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-965746-dc45866d5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-965746-dc45866d5-j5wlw

openshift-ingress

kubelet

payload-processing-e2e-api-a-965746-dc45866d5-j5wlw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-965746-dc45866d5-j5wlw

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-965746-dc45866d5-j5wlw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-965746-dc45866d5-j5wlw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-ee8372-openshift-default-755c799b8b

SuccessfulCreate

Created pod: e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

openshift-ingress

gateway_labeler_controller

e2e-api-b-ee8372

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ee8372

openshift-ingress

deployment-controller

e2e-api-b-ee8372-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ee8372-openshift-default-755c799b8b from 0 to 1

openshift-ingress

multus

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ee8372

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ee8372-7b47d8f7cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ee8372-7b47d8f7cc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ee8372-79997559bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ee8372-79997559bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ee8372: serviceaccount "payload-processing-e2e-api-b-ee8372" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ee8372-79997559bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ee8372-7b47d8f7cc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ee8372-7b47d8f7cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ee8372: serviceaccount "payload-processing-e2e-api-b-ee8372" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ee8372

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ee8372-79997559bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-965746-5df68cfd-qphbs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-965746-dc45866d5-j5wlw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-965746-openshift-default-c64dc8db6-tt7jc

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-ee8372

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-ee8372: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-ee8372": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-ee8372, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7b3078dd-5ca0-4093-8460-b29683a96013, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-ee8372-7b47d8f7cc-7jplz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ee8372-79997559bb-lhksm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-ee8372-openshift-default-755c799b8b-g9bmt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e77525

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e77525

openshift-ingress

deployment-controller

e2e-ipp-a-e77525-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e77525-openshift-default-bbdcccc68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-e77525-openshift-default-bbdcccc68

SuccessfulCreate

Created pod: e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-093570-5df66bf465-m59d5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-093570-7ff886446b-c4w8s

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e77525-68d9f6c959

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e77525-68d9f6c959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e77525: serviceaccount "payload-processing-e2e-ipp-a-e77525" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e77525: serviceaccount "payload-processing-e2e-ipp-a-e77525" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e77525

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e77525

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e77525-68d9f6c959 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e77525-68d9f6c959

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-093570-openshift-default-5f8745c4db-q96gd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c6f2ed-6d4d4c7d7d-22c5d

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c6f2ed-754cf46b8c-nnngp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-b-1a27c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-1a27c5-openshift-default-6547459478 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-1a27c5-openshift-default-6547459478

SuccessfulCreate

Created pod: e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

openshift-ingress

kubelet

e2e-shared-b-w2-c6f2ed-openshift-default-6c65f8b9fb-jnrf8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-1a27c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1a27c5

openshift-ingress

multus

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1a27c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1a27c5: serviceaccount "payload-processing-e2e-ipp-b-1a27c5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1a27c5: serviceaccount "payload-processing-e2e-ipp-b-1a27c5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1a27c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": read tcp 10.133.0.2:33776->10.133.0.72:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": read tcp 10.133.0.2:33776->10.133.0.72:15021: read: connection reset by peer
(x4)

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3a21b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3a21b6

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3a21b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3a21b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3a21b6: serviceaccount "payload-processing-e2e-ipp-cleanup-3a21b6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3a21b6: serviceaccount "payload-processing-e2e-ipp-cleanup-3a21b6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3a21b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": read tcp 10.133.0.2:43970->10.133.0.73:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": read tcp 10.133.0.2:43970->10.133.0.73:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3a21b6-f5455b8cd-6wmlw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3a21b6-588b5656df-4g4lx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3a21b6-openshift-default-8b88b74c8-hfr2p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e77525-699fd6dcc4-dschr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e77525-68d9f6c959-wsjm6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e77525-openshift-default-bbdcccc68-x6g9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a27c5-6f8b8b6d49-cks4p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a27c5-697d4959cd-dt68h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-1a27c5-openshift-default-6547459478-hn2jr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a4001b-fdd9484bc-nkwwm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a4001b-845b6678f4-q95kh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-a4001b-openshift-default-6468b4d6d-f5c79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-525196-55769cf64f-sh4t7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-525196-87cdc9946-5r8wk

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-525196

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-525196: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-525196": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-525196, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0719fc8f-5118-47b4-9d0e-cdccffec226c, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-525196-openshift-default-57c99fb76b-xx2rg

Killing

Stopping container istio-proxy