Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-r72v6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-r72v6 to ip-10-0-132-70.ec2.internal

openshift-ingress

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 to ip-10-0-138-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46 to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5 to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6 to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz to ip-10-0-136-213.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-g488m

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp to ip-10-0-132-70.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7 to ip-10-0-132-70.ec2.internal

openshift-ingress

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6 to ip-10-0-138-27.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656 to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5 to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6 to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4 to ip-10-0-138-27.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-dgxnt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-dgxnt to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm to ip-10-0-138-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5 to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck to ip-10-0-132-70.ec2.internal

openshift-ingress

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb to ip-10-0-136-213.ec2.internal

openshift-ingress

kube-auth-proxy-b5848dcdb-f95p8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b5848dcdb-f95p8 to ip-10-0-132-70.ec2.internal

openshift-ingress

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

Scheduled

Successfully assigned openshift-ingress/e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b to ip-10-0-136-213.ec2.internal

openshift-ingress

router-default-7bff86c86-9d7sj

Scheduled

Successfully assigned openshift-ingress/router-default-7bff86c86-9d7sj to ip-10-0-138-27.ec2.internal

openshift-ingress

router-default-7bff86c86-9d7sj

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-25a681-589db85f95-hgg72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-25a681-589db85f95-hgg72 to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk to ip-10-0-138-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5 to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-4nxnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-4nxnk to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4 to ip-10-0-132-70.ec2.internal

openshift-ingress

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s to ip-10-0-138-27.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9l5xw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9l5xw to ip-10-0-136-213.ec2.internal

openshift-ingress

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt to ip-10-0-138-27.ec2.internal

openshift-ingress

payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh to ip-10-0-136-213.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f to ip-10-0-132-70.ec2.internal

openshift-ingress

kube-auth-proxy-b5848dcdb-bjbmm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm to ip-10-0-138-27.ec2.internal

openshift-ingress

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj to ip-10-0-138-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c to ip-10-0-132-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf to ip-10-0-132-70.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7bff86c86 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-7bff86c86

FailedCreate

Error creating: pods "router-default-7bff86c86-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7bff86c86

FailedCreate

Error creating: pods "router-default-7bff86c86-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-7bff86c86

SuccessfulCreate

Created pod: router-default-7bff86c86-9d7sj
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-7bff86c86-9d7sj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7bff86c86-9d7sj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-7bff86c86-9d7sj

Started

Started container router

openshift-ingress

kubelet

router-default-7bff86c86-9d7sj

Created

Created container: router

openshift-ingress

kubelet

router-default-7bff86c86-9d7sj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-7bff86c86-9d7sj

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-b5848dcdb from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-b5848dcdb

FailedCreate

Error creating: pods "kube-auth-proxy-b5848dcdb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-f95p8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-bjbmm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-b5848dcdb

SuccessfulCreate

Created pod: kube-auth-proxy-b5848dcdb-f95p8

openshift-ingress

replicaset-controller

kube-auth-proxy-b5848dcdb

SuccessfulCreate

Created pod: kube-auth-proxy-b5848dcdb-bjbmm

openshift-ingress

multus

kube-auth-proxy-b5848dcdb-f95p8

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-b5848dcdb-bjbmm

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-g488m

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-g488m

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-f95p8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-f95p8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.535s (2.535s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-bjbmm

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-bjbmm

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g488m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-bjbmm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.579s (2.579s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-b5848dcdb-f95p8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g488m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.233s (2.233s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g488m

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g488m

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g488m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g488m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.656s (2.656s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5wzqp

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-dgxnt

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-dgxnt

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dgxnt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dgxnt

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dgxnt

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dgxnt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.746s (2.746s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dgxnt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-dgxnt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-g488m

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g488m

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9l5xw

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9l5xw

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-r72v6

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-4nxnk

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-r72v6

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-4nxnk

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nxnk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r72v6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nxnk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.475s (2.475s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r72v6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r72v6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-r72v6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.317s (2.317s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nxnk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nxnk

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9l5xw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9l5xw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9l5xw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9l5xw

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9l5xw

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-7f2cd3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-13af27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-13af27

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f3cc69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f3cc69

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-7f2cd3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-7f2cd3

openshift-ingress

deployment-controller

e2e-inf-a-f3cc69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f3cc69-openshift-default-58d744668b from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-13af27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-13af27-openshift-default-56d6fc7588 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-f3cc69-openshift-default-58d744668b

SuccessfulCreate

Created pod: e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

openshift-ingress

replicaset-controller

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74

SuccessfulCreate

Created pod: e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

openshift-ingress

replicaset-controller

e2e-worker-w4-13af27-openshift-default-56d6fc7588

SuccessfulCreate

Created pod: e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

openshift-ingress

multus

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.842s (2.842s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7f2cd3: serviceaccount "payload-processing-e2e-worker-w0-7f2cd3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-7f2cd3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-7f2cd3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-7f2cd3-7b657658d5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-7f2cd3: serviceaccount "payload-processing-e2e-worker-w0-7f2cd3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-13af27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-13af27: serviceaccount "payload-processing-e2e-worker-w4-13af27" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-13af27-8d6d7b69f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-13af27-8d6d7b69f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-13af27: serviceaccount "payload-processing-e2e-worker-w4-13af27" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-13af27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-13af27-8d6d7b69f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-13af27-8d6d7b69f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-e79d9e97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e79d9e97-openshift-default-6f46b4fcbb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f3cc69-77cc47584f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f3cc69-77cc47584f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f3cc69-77cc47584f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f3cc69: serviceaccount "payload-processing-e2e-inf-a-f3cc69" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f3cc69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f3cc69-77cc47584f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f3cc69: serviceaccount "payload-processing-e2e-inf-a-f3cc69" not found

openshift-ingress

replicaset-controller

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb

SuccessfulCreate

Created pod: e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656

openshift-ingress

gateway_labeler_controller

e2e-ait-e79d9e97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e79d9e97

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f3cc69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-53c734

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-53c734

openshift-ingress

deployment-controller

e2e-autores-53c734-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-53c734-openshift-default-67d97c479b from 0 to 1

openshift-ingress

multus

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-53c734-openshift-default-67d97c479b

SuccessfulCreate

Created pod: e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

openshift-ingress

multus

payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e79d9e97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e79d9e97: serviceaccount "payload-processing-e2e-ait-e79d9e97" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e79d9e97-7948566c85

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e79d9e97-7948566c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e79d9e97: serviceaccount "payload-processing-e2e-ait-e79d9e97" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e79d9e97-7948566c85

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e79d9e97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e79d9e97-7948566c85 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-53c734

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-53c734-b4c7d47d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-53c734-b4c7d47d7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-53c734-b4c7d47d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-53c734: serviceaccount "payload-processing-e2e-autores-53c734" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-53c734

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-53c734-7f7466cd7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-53c734-7f7466cd7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-53c734-b4c7d47d7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb

openshift-ingress

multus

payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-53c734-7f7466cd7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-53c734-7f7466cd7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-53c734: serviceaccount "payload-processing-e2e-autores-53c734" not found

openshift-ingress

multus

payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:33206->10.132.0.56:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:33206->10.132.0.56:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-c9a840-openshift-default-7bbf97fd94

SuccessfulCreate

Created pod: e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

openshift-ingress

deployment-controller

e2e-inf-b-c9a840-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c9a840-openshift-default-7bbf97fd94 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c9a840

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c9a840

openshift-ingress

multus

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c9a840-66b54f7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c9a840-66b54f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c9a840: serviceaccount "payload-processing-e2e-inf-b-c9a840" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c9a840: serviceaccount "payload-processing-e2e-inf-b-c9a840" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c9a840

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c9a840-77d984d77d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c9a840

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c9a840-66b54f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c9a840-66b54f7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e79d9e97-55f9bf98c8-lmwkf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e79d9e97-7948566c85-fflb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-d778192d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d778192d-gw-openshift-default-5794d79b84 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-d778192d-gw-openshift-default-5794d79b84

SuccessfulCreate

Created pod: e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

openshift-ingress

gateway_labeler_controller

e2e-migrate-d778192d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d778192d-gw
(x2)

openshift-ingress

kubelet

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-e79d9e97-openshift-default-6f46b4fcbb-g8l9t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d778192d-56c99d84db

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d778192d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d778192d-887fc4b94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d778192d-887fc4b94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d778192d-56c99d84db

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d778192d-56c99d84db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d778192d: serviceaccount "payload-processing-e2e-migrate-d778192d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d778192d-887fc4b94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d778192d-887fc4b94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d778192d: serviceaccount "payload-processing-e2e-migrate-d778192d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d778192d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d778192d-56c99d84db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-d778192d-56c99d84db-pll6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d778192d-887fc4b94-fkrmz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-eb4df850-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-eb4df850-openshift-default-7bf98856b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-eb4df850

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-eb4df850

openshift-ingress

replicaset-controller

e2e-ait-eb4df850-openshift-default-7bf98856b8

SuccessfulCreate

Created pod: e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

openshift-ingress

multus

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-eb4df850

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-eb4df850-749bb878d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eb4df850-749bb878d7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-eb4df850-749bb878d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eb4df850: serviceaccount "payload-processing-e2e-ait-eb4df850" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-eb4df850

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-eb4df850-54578f59c4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eb4df850-749bb878d7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eb4df850-54578f59c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq

openshift-ingress

kubelet

payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eb4df850-54578f59c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-eb4df850-54578f59c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eb4df850: serviceaccount "payload-processing-e2e-ait-eb4df850" not found
(x2)

openshift-ingress

kubelet

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eb4df850-54578f59c4-j4jpq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eb4df850-749bb878d7-dc24w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-eb4df850-openshift-default-7bf98856b8-2wwvl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-ead8c2c2-openshift-default-776c85d596

SuccessfulCreate

Created pod: e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

openshift-ingress

deployment-controller

e2e-derive-ead8c2c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ead8c2c2-openshift-default-776c85d596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-ead8c2c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ead8c2c2

openshift-ingress

multus

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ead8c2c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ead8c2c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ead8c2c2-54c4c6459c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ead8c2c2: serviceaccount "payload-processing-e2e-derive-ead8c2c2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ead8c2c2-54c4c6459c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ead8c2c2-54c4c6459c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ead8c2c2-54c4c6459c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ead8c2c2: serviceaccount "payload-processing-e2e-derive-ead8c2c2" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-ead8c2c2-54c4c6459c-rdlgz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ead8c2c2-567cd9c5c4-jgcn5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-53c734-b4c7d47d7-hchbb

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-53c734

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-53c734: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-53c734": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-53c734, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e7e72338-2825-4148-9d47-1eca4308ba06, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-53c734-7f7466cd7d-l5svk

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-explicit-ea9ba2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ea9ba2-openshift-default-7b7677547b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-ea9ba2-openshift-default-7b7677547b

SuccessfulCreate

Created pod: e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

openshift-ingress

kubelet

e2e-autores-53c734-openshift-default-67d97c479b-wxvzk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-ea9ba2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ea9ba2

openshift-ingress

multus

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ea9ba2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ea9ba2-764b5f9b85 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ea9ba2: serviceaccount "payload-processing-e2e-explicit-ea9ba2" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ea9ba2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ea9ba2-764b5f9b85

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ea9ba2-764b5f9b85

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ea9ba2-764b5f9b85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ea9ba2: serviceaccount "payload-processing-e2e-explicit-ea9ba2" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb

SuccessfulCreate

Created pod: e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

openshift-ingress

gateway_labeler_controller

e2e-mt-aa81ae79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-aa81ae79

openshift-ingress

multus

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-aa81ae79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-aa81ae79-openshift-default-5f84fb4ccb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aa81ae79-cbfdd557

FailedCreate

Error creating: pods "payload-processing-e2e-mt-aa81ae79-cbfdd557-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aa81ae79: serviceaccount "payload-processing-e2e-mt-aa81ae79" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-aa81ae79-cbfdd557

SuccessfulCreate

Created pod: payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-aa81ae79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-aa81ae79: serviceaccount "payload-processing-e2e-mt-aa81ae79" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-aa81ae79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-aa81ae79-cbfdd557 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-ea9ba2-764b5f9b85-4m89h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ea9ba2-6bc57c46c4-6j46t

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-3e5c28-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-3e5c28-openshift-default-54bd7b5c5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-3e5c28-openshift-default-54bd7b5c5b

SuccessfulCreate

Created pod: e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

openshift-ingress

gateway_labeler_controller

e2e-noten-3e5c28

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-3e5c28

openshift-ingress

kubelet

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-aa81ae79-69f5f7d6d6-bw8zx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-aa81ae79-cbfdd557-j2sjx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-25bd47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-25bd47

openshift-ingress

deployment-controller

e2e-shared-a-w2-25bd47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4

SuccessfulCreate

Created pod: e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-25bd47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-25bd47: serviceaccount "payload-processing-e2e-shared-a-w2-25bd47" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-25bd47: serviceaccount "payload-processing-e2e-shared-a-w2-25bd47" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-25bd47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-97ffde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-97ffde
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-97ffde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6

SuccessfulCreate

Created pod: e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

openshift-ingress

multus

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-97ffde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669 from 0 to 1

openshift-ingress

kubelet

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-3e5c28-openshift-default-54bd7b5c5b-nk65b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-97ffde: serviceaccount "payload-processing-e2e-shared-b-w2-97ffde" not found
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-97ffde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-97ffde: serviceaccount "payload-processing-e2e-shared-b-w2-97ffde" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f3cc69-77cc47584f-xqcbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f3cc69-5c6b587cc8-9b656

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

Unhealthy

Readiness probe failed: dial tcp 10.133.0.41:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c9a840-77d984d77d-sr57g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c9a840-66b54f7-crhs7

Unhealthy

Readiness probe failed: dial tcp 10.133.0.42:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-7f2cd3-7b657658d5-cw6vz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-7f2cd3-669dd86494-w9fv5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-4bfef6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-4bfef6

openshift-ingress

deployment-controller

e2e-shared-a-w3-4bfef6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d

SuccessfulCreate

Created pod: e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

openshift-ingress

gateway_labeler_controller

e2e-mt-8fcf3f8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8fcf3f8b

openshift-ingress

replicaset-controller

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6

SuccessfulCreate

Created pod: e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

openshift-ingress

deployment-controller

e2e-mt-8fcf3f8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8fcf3f8b-openshift-default-6549f5c64d from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-7f2cd3-openshift-default-5db5ff7c74-clb9l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-13af27-8d6d7b69f-9j8ck

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-13af27-74b57d49b6-6c49c

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8fcf3f8b: serviceaccount "payload-processing-e2e-mt-8fcf3f8b" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8fcf3f8b: serviceaccount "payload-processing-e2e-mt-8fcf3f8b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8fcf3f8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8fcf3f8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6

openshift-ingress

kubelet

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-4bfef6: serviceaccount "payload-processing-e2e-shared-a-w3-4bfef6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-4bfef6: serviceaccount "payload-processing-e2e-shared-a-w3-4bfef6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-4bfef6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-4bfef6-7784594f89 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-4bfef6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-13af27-openshift-default-56d6fc7588-sb2b5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6

SuccessfulCreate

Created pod: e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46
(x5)

openshift-ingress

kubelet

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-3b702d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-3b702d

openshift-ingress

deployment-controller

e2e-shared-b-w3-3b702d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-3b702d-openshift-default-9d49444b6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3b702d: serviceaccount "payload-processing-e2e-shared-b-w3-3b702d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-3b702d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-3b702d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3b702d: serviceaccount "payload-processing-e2e-shared-b-w3-3b702d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8fcf3f8b-7dbfcbcc74-rxtzj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8fcf3f8b-7cd7cc74d9-w6nh6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-c5e779

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c5e779

openshift-ingress

deployment-controller

e2e-api-a-c5e779-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c5e779-openshift-default-677496987b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-c5e779-openshift-default-677496987b

SuccessfulCreate

Created pod: e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

openshift-ingress

multus

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c5e779-6b4cd6d975

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c5e779-6b4cd6d975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5e779: serviceaccount "payload-processing-e2e-api-a-c5e779" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c5e779

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c5e779-6f7969697d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c5e779-6f7969697d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c5e779-6f7969697d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c5e779-6f7969697d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5e779: serviceaccount "payload-processing-e2e-api-a-c5e779" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c5e779

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c5e779-6b4cd6d975 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c5e779-6b4cd6d975

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-25a681

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-25a681

openshift-ingress

replicaset-controller

e2e-api-b-25a681-openshift-default-6dbf568b48

SuccessfulCreate

Created pod: e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

openshift-ingress

deployment-controller

e2e-api-b-25a681-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-25a681-openshift-default-6dbf568b48 from 0 to 1

openshift-ingress

multus

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-25a681-58f5db578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-25a681

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-25a681-589db85f95 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-25a681-58f5db578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-25a681-58f5db578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-25a681: serviceaccount "payload-processing-e2e-api-b-25a681" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-25a681-589db85f95

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-25a681-589db85f95-hgg72

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-25a681

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-25a681-58f5db578 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-25a681-589db85f95

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-25a681-589db85f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-25a681: serviceaccount "payload-processing-e2e-api-b-25a681" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-25a681-589db85f95-hgg72

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-25a681-589db85f95-hgg72

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-25a681-589db85f95-hgg72

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-25a681-589db85f95-hgg72

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-c5e779

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-c5e779: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-c5e779": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-c5e779, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b1822445-a912-4693-a716-020b7254a763, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5e779-6b4cd6d975-qcb7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5e779-6f7969697d-k5vlg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-c5e779-openshift-default-677496987b-fwhkt

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-25a681

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-25a681: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-25a681": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-25a681, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b8a96fd5-b46c-434d-9b7f-8d53070d579b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-25a681-589db85f95-hgg72

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-25a681-58f5db578-5pw7h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-25a681-openshift-default-6dbf568b48-gnr8s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-25bd47-9b4cbf994-kshtq

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-25bd47

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-25bd47: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-25bd47": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-25bd47, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e46bcb98-a570-46e1-b75c-7fbe3db9aec1, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-25bd47-6fbdb78469-cktlw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97ffde-5bc556b986-jsrct

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97ffde-9b9cc7669-kh2fx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-95427a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-95427a-openshift-default-5df7c968f4 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-95427a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-95427a

openshift-ingress

replicaset-controller

e2e-ipp-a-95427a-openshift-default-5df7c968f4

SuccessfulCreate

Created pod: e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-95427a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-95427a: serviceaccount "payload-processing-e2e-ipp-a-95427a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-95427a-85cd475c65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-95427a-85cd475c65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-95427a: serviceaccount "payload-processing-e2e-ipp-a-95427a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-95427a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-95427a-85cd475c65 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-95427a-85cd475c65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

ProbeError

Readiness probe error: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

Unhealthy

Readiness probe failed: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-1c7644

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1c7644

openshift-ingress

deployment-controller

e2e-ipp-b-1c7644-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-1c7644-openshift-default-fb44f75f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-1c7644-openshift-default-fb44f75f4

SuccessfulCreate

Created pod: e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

openshift-ingress

multus

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1c7644-7f49987b6f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1c7644: serviceaccount "payload-processing-e2e-ipp-b-1c7644" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1c7644

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1c7644-7f49987b6f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1c7644-7f49987b6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1c7644: serviceaccount "payload-processing-e2e-ipp-b-1c7644" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1c7644

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1c7644-7f49987b6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Unhealthy

Readiness probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

ProbeError

Readiness probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-56fdcd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-56fdcd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-56fdcd

openshift-ingress

multus

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-56fdcd: serviceaccount "payload-processing-e2e-ipp-cleanup-56fdcd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-56fdcd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-56fdcd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-56fdcd: serviceaccount "payload-processing-e2e-ipp-cleanup-56fdcd" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-56fdcd-b867c7fc9-ql9c4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-56fdcd-5f765c4c4-kmzzr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-56fdcd-openshift-default-56bf7cfd7b-dxbbb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95427a-5ccbcb995d-gvxs5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95427a-85cd475c65-grf9f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1c7644-7f49987b6f-9g4xh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1c7644-58d9fdc9f8-fbkld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4bfef6-7784594f89-2g5dv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4bfef6-6c87469954-fl6zn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3b702d-d96f89998-2pscf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3b702d-b9dc5c997-7sf2q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-3b702d-openshift-default-9d49444b6-j4z46

Killing

Stopping container istio-proxy