Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7 to ip-10-0-134-189.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-8thv6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6 to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9 to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8 to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm to ip-10-0-134-233.ec2.internal

openshift-ingress

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq to ip-10-0-134-233.ec2.internal

openshift-ingress

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf to ip-10-0-143-253.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-6m92t

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-6m92t to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f0250e49-openshift-default-664bb69d6-p626z to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f60615-57548b9865-lnq8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f60615-57548b9865-lnq8k to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5 to ip-10-0-143-253.ec2.internal

openshift-ingress

kube-auth-proxy-5868776b49-nkdlk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5868776b49-nkdlk to ip-10-0-134-189.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-t99z2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2 to ip-10-0-134-233.ec2.internal

openshift-ingress

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5 to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2 to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285 to ip-10-0-143-253.ec2.internal

openshift-ingress

kube-auth-proxy-5868776b49-8d8bb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5868776b49-8d8bb to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94 to ip-10-0-134-189.ec2.internal

openshift-ingress

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk to ip-10-0-134-189.ec2.internal

openshift-ingress

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v to ip-10-0-134-233.ec2.internal

openshift-ingress

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj to ip-10-0-134-233.ec2.internal

openshift-ingress

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-pm7kk

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-pm7kk to ip-10-0-134-189.ec2.internal

openshift-ingress

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7 to ip-10-0-134-189.ec2.internal

openshift-ingress

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h to ip-10-0-134-189.ec2.internal

openshift-ingress

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf to ip-10-0-134-233.ec2.internal

openshift-ingress

router-default-74f86cdcc6-86wzz

Scheduled

Successfully assigned openshift-ingress/router-default-74f86cdcc6-86wzz to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-k9fdk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-k9fdk to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2 to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

Scheduled

Successfully assigned openshift-ingress/e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6 to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp to ip-10-0-143-253.ec2.internal

openshift-ingress

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94 to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc to ip-10-0-143-253.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj to ip-10-0-143-253.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx to ip-10-0-134-189.ec2.internal

openshift-ingress

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg to ip-10-0-134-189.ec2.internal

openshift-ingress

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7 to ip-10-0-134-233.ec2.internal

openshift-ingress

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6 to ip-10-0-134-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf to ip-10-0-134-189.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp to ip-10-0-143-253.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-74f86cdcc6 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-74f86cdcc6

FailedCreate

Error creating: pods "router-default-74f86cdcc6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-74f86cdcc6

FailedCreate

Error creating: pods "router-default-74f86cdcc6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-74f86cdcc6

SuccessfulCreate

Created pod: router-default-74f86cdcc6-86wzz
(x6)

openshift-ingress

kubelet

router-default-74f86cdcc6-86wzz

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-74f86cdcc6-86wzz

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-74f86cdcc6-86wzz

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-74f86cdcc6-86wzz

Started

Started container router

openshift-ingress

kubelet

router-default-74f86cdcc6-86wzz

Created

Created container: router

openshift-ingress

multus

router-default-74f86cdcc6-86wzz

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-5868776b49

FailedCreate

Error creating: pods "kube-auth-proxy-5868776b49-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5868776b49 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5868776b49

SuccessfulCreate

Created pod: kube-auth-proxy-5868776b49-8d8bb

openshift-ingress

replicaset-controller

kube-auth-proxy-5868776b49

SuccessfulCreate

Created pod: kube-auth-proxy-5868776b49-nkdlk

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-8d8bb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5868776b49-8d8bb

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5868776b49-nkdlk

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-nkdlk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-t99z2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-nkdlk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.908s (2.908s including waiting). Image size: 265120132 bytes.

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-t99z2

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-nkdlk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-nkdlk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t99z2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-8d8bb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.964s (2.964s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-8d8bb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5868776b49-8d8bb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t99z2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t99z2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t99z2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.438s (2.438s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t99z2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t99z2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kjl6k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.42s (2.42s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-6m92t

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-6m92t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-6m92t

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-6m92t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.514s (3.514s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-6m92t

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-6m92t

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t99z2

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-t99z2
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-8thv6

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8thv6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-8thv6

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8thv6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.785s (2.785s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-k9fdk

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-pm7kk

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-k9fdk

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k9fdk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-pm7kk

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm7kk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k9fdk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k9fdk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.319s (1.32s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k9fdk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm7kk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm7kk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm7kk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.269s (2.269s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8thv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8thv6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8thv6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8thv6

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8thv6

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-c1aebc-openshift-default-5c87857866

SuccessfulCreate

Created pod: e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

openshift-ingress

deployment-controller

e2e-worker-w4-c1aebc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c1aebc-openshift-default-5c87857866 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-c6c610-openshift-default-6d5c9cd588

SuccessfulCreate

Created pod: e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

openshift-ingress

deployment-controller

e2e-worker-w0-62499f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-62499f-openshift-default-7cfd76554d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-62499f-openshift-default-7cfd76554d

SuccessfulCreate

Created pod: e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

openshift-ingress

multus

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-c6c610-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-c6c610-openshift-default-6d5c9cd588 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-62499f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-62499f

openshift-ingress

gateway_labeler_controller

e2e-inf-a-c6c610

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-c6c610

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-c1aebc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-c1aebc

openshift-ingress

multus

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-c1aebc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c1aebc: serviceaccount "payload-processing-e2e-worker-w4-c1aebc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-c1aebc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c1aebc: serviceaccount "payload-processing-e2e-worker-w4-c1aebc" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-62499f-d965645b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-62499f-d965645b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-62499f: serviceaccount "payload-processing-e2e-worker-w0-62499f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-62499f-d965645b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-62499f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-62499f-84fdbfb547 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-62499f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-62499f-d965645b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-62499f-84fdbfb547

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-62499f-84fdbfb547

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-62499f-84fdbfb547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-62499f: serviceaccount "payload-processing-e2e-worker-w0-62499f" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-autores-89e163

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-89e163

openshift-ingress

deployment-controller

e2e-autores-89e163-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-89e163-openshift-default-7774f9d49d from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-89e163-openshift-default-7774f9d49d

SuccessfulCreate

Created pod: e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

openshift-ingress

multus

payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c6c610-8cf45f4d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-c6c610-8cf45f4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c6c610: serviceaccount "payload-processing-e2e-inf-a-c6c610" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-c6c610

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-c6c610-5fc577f878 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-c6c610

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-c6c610-8cf45f4d7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c6c610-8cf45f4d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c6c610: serviceaccount "payload-processing-e2e-inf-a-c6c610" not found

openshift-ingress

multus

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-aff2b8e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-aff2b8e2

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-ait-aff2b8e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-aff2b8e2-openshift-default-6997d749c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-aff2b8e2-openshift-default-6997d749c6

SuccessfulCreate

Created pod: e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

openshift-ingress

multus

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aff2b8e2: serviceaccount "payload-processing-e2e-ait-aff2b8e2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aff2b8e2-869b4874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-aff2b8e2-869b4874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aff2b8e2: serviceaccount "payload-processing-e2e-ait-aff2b8e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh

openshift-ingress

deployment-controller

payload-processing-e2e-ait-aff2b8e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-aff2b8e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-aff2b8e2-869b4874 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aff2b8e2-869b4874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

ProbeError

Readiness probe error: Get "http://10.134.0.31:15021/healthz/ready": read tcp 10.134.0.2:53668->10.134.0.31:15021: read: connection reset by peer body:

openshift-ingress

deployment-controller

payload-processing-e2e-autores-89e163

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-89e163-5cf97d8fcc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

Unhealthy

Readiness probe failed: Get "http://10.134.0.31:15021/healthz/ready": read tcp 10.134.0.2:53668->10.134.0.31:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-89e163

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-89e163-7f59cdb9fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-89e163-5cf97d8fcc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-89e163-5cf97d8fcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-89e163: serviceaccount "payload-processing-e2e-autores-89e163" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-89e163-5cf97d8fcc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-89e163: serviceaccount "payload-processing-e2e-autores-89e163" not found
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-093f6c-openshift-default-b5fc96998

SuccessfulCreate

Created pod: e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

openshift-ingress

deployment-controller

e2e-inf-b-093f6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-093f6c-openshift-default-b5fc96998 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-093f6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-093f6c

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-093f6c-95489bbfc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-093f6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-093f6c-95489bbfc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-093f6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-093f6c-858444c8bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-093f6c: serviceaccount "payload-processing-e2e-inf-b-093f6c" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-093f6c-95489bbfc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-093f6c-95489bbfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-093f6c: serviceaccount "payload-processing-e2e-inf-b-093f6c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aff2b8e2-869b4874-9ztfb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-aff2b8e2-78cdcdd9ff-4pzwh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4

SuccessfulCreate

Created pod: e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

openshift-ingress

gateway_labeler_controller

e2e-migrate-c158570a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c158570a-gw

openshift-ingress

deployment-controller

e2e-migrate-c158570a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c158570a-gw-openshift-default-6f4b967d4 from 0 to 1

openshift-ingress

multus

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-aff2b8e2-openshift-default-6997d749c6-wwp7k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c158570a-5786998d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c158570a-5786998d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c158570a: serviceaccount "payload-processing-e2e-migrate-c158570a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c158570a-7d585d68b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c158570a-7d585d68b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c158570a-7d585d68b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c158570a: serviceaccount "payload-processing-e2e-migrate-c158570a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c158570a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c158570a-5786998d6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c158570a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c158570a-7d585d68b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c158570a-5786998d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-c158570a-7d585d68b-s9hpm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c158570a-5786998d6b-v874h

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-f0250e49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f0250e49

openshift-ingress

deployment-controller

e2e-ait-f0250e49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f0250e49-openshift-default-664bb69d6 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-f0250e49-openshift-default-664bb69d6

SuccessfulCreate

Created pod: e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

openshift-ingress

multus

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f0250e49-546cf645d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x

openshift-ingress

kubelet

payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f0250e49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f0250e49-546cf645d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f0250e49-7d8b66b5d5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f0250e49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f0250e49-7d8b66b5d5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f0250e49-546cf645d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f0250e49-546cf645d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f0250e49: serviceaccount "payload-processing-e2e-ait-f0250e49" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f0250e49-7d8b66b5d5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f0250e49-7d8b66b5d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f0250e49: serviceaccount "payload-processing-e2e-ait-f0250e49" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f0250e49-546cf645d-mh69x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f0250e49-7d8b66b5d5-v5b94

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-f0250e49-openshift-default-664bb69d6-p626z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-8092ee69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8092ee69-openshift-default-db77946fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-8092ee69-openshift-default-db77946fb

SuccessfulCreate

Created pod: e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

openshift-ingress

gateway_labeler_controller

e2e-derive-8092ee69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8092ee69

openshift-ingress

multus

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8092ee69-67cdbf7cb9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8092ee69-67cdbf7cb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8092ee69: serviceaccount "payload-processing-e2e-derive-8092ee69" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8092ee69-67cdbf7cb9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8092ee69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8092ee69-67cdbf7cb9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8092ee69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8092ee69: serviceaccount "payload-processing-e2e-derive-8092ee69" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-89e163-5cf97d8fcc-7qq94

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-89e163-7f59cdb9fd-llrzp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8092ee69-5bc7bb9cbb-bvlg2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8092ee69-67cdbf7cb9-69wv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-8092ee69-openshift-default-db77946fb-p49d7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-f60615

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f60615

openshift-ingress

replicaset-controller

e2e-explicit-f60615-openshift-default-667c4c9cd4

SuccessfulCreate

Created pod: e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

openshift-ingress

deployment-controller

e2e-explicit-f60615-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f60615-openshift-default-667c4c9cd4 from 0 to 1

openshift-ingress

multus

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-89e163-openshift-default-7774f9d49d-ddkg6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-explicit-f60615-57548b9865-lnq8k

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f60615: serviceaccount "payload-processing-e2e-explicit-f60615" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f60615

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f60615-57548b9865-lnq8k

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f60615

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f60615-57548b9865 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-f60615-57548b9865-lnq8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-f60615-57548b9865-lnq8k

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f60615-57548b9865

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f60615-57548b9865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f60615: serviceaccount "payload-processing-e2e-explicit-f60615" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f60615-57548b9865

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f60615-57548b9865-lnq8k
(x2)

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": read tcp 10.133.0.2:44762->10.133.0.67:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": read tcp 10.133.0.2:44762->10.133.0.67:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-9a60dde0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9a60dde0

openshift-ingress

multus

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-9a60dde0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9a60dde0-openshift-default-7ddd8989d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-9a60dde0-openshift-default-7ddd8989d4

SuccessfulCreate

Created pod: e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

openshift-ingress

multus

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9a60dde0-6596756674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9a60dde0-6596756674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9a60dde0-6596756674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9a60dde0: serviceaccount "payload-processing-e2e-mt-9a60dde0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9a60dde0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9a60dde0-6596756674 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9a60dde0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9a60dde0: serviceaccount "payload-processing-e2e-mt-9a60dde0" not found
(x2)

openshift-ingress

kubelet

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-f60615-57548b9865-lnq8k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f60615-7bf45f6cf8-qr6xv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-f70e4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f70e4e

openshift-ingress

kubelet

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-noten-f70e4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f70e4e-openshift-default-6547b97cd6 from 0 to 1

openshift-ingress

kubelet

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-9a60dde0-7f7d5f4dd5-rlpsj

Unhealthy

Readiness probe failed: dial tcp 10.132.0.56:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9a60dde0-6596756674-zq285

Unhealthy

Readiness probe failed: dial tcp 10.132.0.57:9004: connect: connection refused

openshift-ingress

kubelet

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-f70e4e-openshift-default-6547b97cd6

SuccessfulCreate

Created pod: e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

openshift-ingress

kubelet

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4

SuccessfulCreate

Created pod: e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

openshift-ingress

multus

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-19647e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-19647e

openshift-ingress

deployment-controller

e2e-shared-a-w2-19647e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-19647e-openshift-default-67c648f8c4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-19647e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-19647e: serviceaccount "payload-processing-e2e-shared-a-w2-19647e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-19647e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-19647e-5597cc7b89 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-19647e: serviceaccount "payload-processing-e2e-shared-a-w2-19647e" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c6c610-5fc577f878-9vstp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-c6c610

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-c6c610: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-c6c610": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-c6c610, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 72ba8eb8-9f94-48a8-abca-d560e56c63b1, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c6c610-8cf45f4d7-lq42w

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-37ce96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-37ce96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-37ce96

openshift-ingress

replicaset-controller

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798

SuccessfulCreate

Created pod: e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

openshift-ingress

multus

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093f6c-95489bbfc-bzdnp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093f6c-858444c8bb-8lbvc

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-37ce96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-37ce96: serviceaccount "payload-processing-e2e-shared-b-w2-37ce96" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-37ce96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-37ce96: serviceaccount "payload-processing-e2e-shared-b-w2-37ce96" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-093f6c-openshift-default-b5fc96998-8cgj5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-8280eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-8280eb-openshift-default-5566668bcd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-8280eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-8280eb

openshift-ingress

multus

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd

SuccessfulCreate

Created pod: e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8280eb-555c875689

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8280eb-555c875689

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-8280eb-555c875689-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8280eb: serviceaccount "payload-processing-e2e-shared-a-w3-8280eb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-8280eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-8280eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-8280eb-555c875689 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8280eb: serviceaccount "payload-processing-e2e-shared-a-w3-8280eb" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-mt-7ad53a9d

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-7ad53a9d-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-7ad53a9d-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-mt-7ad53a9d-openshift-default-774589976

SuccessfulCreate

Created pod: e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

openshift-ingress

gateway_labeler_controller

e2e-mt-7ad53a9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7ad53a9d

openshift-ingress

deployment-controller

e2e-mt-7ad53a9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7ad53a9d-openshift-default-774589976 from 0 to 1

openshift-ingress

multus

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-3b7391-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-3b7391

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-3b7391
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7ad53a9d-57cd7b475c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7ad53a9d-57cd7b475c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7ad53a9d: serviceaccount "payload-processing-e2e-mt-7ad53a9d" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd

SuccessfulCreate

Created pod: e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7ad53a9d: serviceaccount "payload-processing-e2e-mt-7ad53a9d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7ad53a9d-57cd7b475c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg

openshift-ingress

multus

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7ad53a9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7ad53a9d-57cd7b475c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7ad53a9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3b7391: serviceaccount "payload-processing-e2e-shared-b-w3-3b7391" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3b7391: serviceaccount "payload-processing-e2e-shared-b-w3-3b7391" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-3b7391

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-3b7391

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-62499f-d965645b6-cd4vl

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-62499f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-62499f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-62499f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-62499f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9cfc68fb-a21a-49b2-ae65-d317b96fc741, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-62499f-84fdbfb547-mjj5f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ad53a9d-8c87b79f4-hzpqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7ad53a9d-57cd7b475c-mzpjg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-7ad53a9d-openshift-default-774589976-64tsl

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-7c10b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7c10b1

openshift-ingress

replicaset-controller

e2e-api-a-7c10b1-openshift-default-85669dc848

SuccessfulCreate

Created pod: e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

openshift-ingress

deployment-controller

e2e-api-a-7c10b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7c10b1-openshift-default-85669dc848 from 0 to 1

openshift-ingress

multus

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7c10b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7c10b1-5694f468b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7c10b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7c10b1-85ffc8cddc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7c10b1-85ffc8cddc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7c10b1-85ffc8cddc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7c10b1-85ffc8cddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7c10b1: serviceaccount "payload-processing-e2e-api-a-7c10b1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7c10b1: serviceaccount "payload-processing-e2e-api-a-7c10b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

openshift-ingress

multus

payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-852059-openshift-default-8469c6d88d

SuccessfulCreate

Created pod: e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

openshift-ingress

deployment-controller

e2e-api-b-852059-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-852059-openshift-default-8469c6d88d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-852059

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-852059
(x5)

openshift-ingress

kubelet

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-852059

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-852059-55b7677bf4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-852059

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-852059-77dc97fdc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-852059-55b7677bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7

openshift-ingress

multus

payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-852059-55b7677bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-852059-55b7677bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-852059: serviceaccount "payload-processing-e2e-api-b-852059" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-852059-77dc97fdc5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-852059-77dc97fdc5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-852059-77dc97fdc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-852059: serviceaccount "payload-processing-e2e-api-b-852059" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-7c10b1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-7c10b1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-7c10b1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-7c10b1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f187b643-71bf-4ab8-a526-9f79d8fde4de, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7c10b1-85ffc8cddc-qw49x

Unhealthy

Readiness probe failed: dial tcp 10.134.0.71:9004: i/o timeout

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7c10b1-5694f468b6-7bkqx

Unhealthy

Readiness probe failed: dial tcp 10.134.0.70:9004: i/o timeout

openshift-ingress

kubelet

e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c1aebc-744d4cb8b6-jvmwv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c1aebc-67f6f6bbb9-lqhg9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-852059-77dc97fdc5-46kwf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-852059-55b7677bf4-qmwk7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-c1aebc-openshift-default-5c87857866-4s5ww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-852059-openshift-default-8469c6d88d-9l84f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-19647e-5597cc7b89-l26hq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-19647e-6849d859cd-txmcp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-37ce96-595f449bfd-jmvlj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-37ce96-85fb758d8f-wqfhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-021613-openshift-default-768fc4f4bd

SuccessfulCreate

Created pod: e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-021613

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-021613

openshift-ingress

deployment-controller

e2e-ipp-a-021613-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-021613-openshift-default-768fc4f4bd from 0 to 1

openshift-ingress

multus

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-021613-564789ccc5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-021613-564789ccc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-021613: serviceaccount "payload-processing-e2e-ipp-a-021613" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-021613-564789ccc5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-021613

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-021613: serviceaccount "payload-processing-e2e-ipp-a-021613" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-021613

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-021613-564789ccc5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-afd85c-openshift-default-7d69487dfd

SuccessfulCreate

Created pod: e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

openshift-ingress

deployment-controller

e2e-ipp-b-afd85c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-afd85c-openshift-default-7d69487dfd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-afd85c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-afd85c

openshift-ingress

multus

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-afd85c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-afd85c-865fdbc7b5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-afd85c: serviceaccount "payload-processing-e2e-ipp-b-afd85c" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-afd85c: serviceaccount "payload-processing-e2e-ipp-b-afd85c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-afd85c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96

SuccessfulCreate

Created pod: e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

openshift-ingress

deployment-controller

e2e-ipp-cleanup-75b1ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-75b1ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-75b1ed

openshift-ingress

multus

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-75b1ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-75b1ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-75b1ed: serviceaccount "payload-processing-e2e-ipp-cleanup-75b1ed" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-75b1ed: serviceaccount "payload-processing-e2e-ipp-cleanup-75b1ed" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-75b1ed-57b8fff9f-fj4fl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-75b1ed-65b646cd54-q6zkf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-021613-7ddc8f8c7d-94nhx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-021613-564789ccc5-2f8qz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-afd85c-5c4cfc56c4-jw45m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-afd85c-865fdbc7b5-j4ncm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-afd85c-openshift-default-7d69487dfd-hvsgv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8280eb-555c875689-k69qp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8280eb-5c759788c8-kgjp2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b7391-657b9d7cd7-skk9z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b7391-547f4697f4-gmxlh

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-3b7391

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3b7391: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-3b7391": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3b7391, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7a26d14a-9708-4937-8399-f9b2a811bb63, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-3b7391-openshift-default-7cd68cb6bd-kwtt7

Killing

Stopping container istio-proxy