Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv

Scheduled

Successfully assigned openshift-ingress/e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv to ip-10-0-131-207.ec2.internal

openshift-ingress

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb to ip-10-0-136-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7 to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-b402ba-669746769-ncr7s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-b402ba-669746769-ncr7s to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj to ip-10-0-128-117.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-m8t9v

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v to ip-10-0-136-24.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb to ip-10-0-131-207.ec2.internal

openshift-ingress

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx to ip-10-0-136-24.ec2.internal

openshift-ingress

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh to ip-10-0-136-24.ec2.internal

openshift-ingress

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4 to ip-10-0-136-24.ec2.internal

openshift-ingress

payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95 to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv to ip-10-0-136-24.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn to ip-10-0-136-24.ec2.internal

openshift-ingress

payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625 to ip-10-0-131-207.ec2.internal

openshift-ingress

kube-auth-proxy-9b9df8cfb-ncf29

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9b9df8cfb-ncf29 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-xj6c6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-xj6c6 to ip-10-0-128-117.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-chp7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-chp7l to ip-10-0-131-207.ec2.internal

openshift-ingress

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct to ip-10-0-128-117.ec2.internal

openshift-ingress

kube-auth-proxy-9b9df8cfb-9dbml

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml to ip-10-0-136-24.ec2.internal

openshift-ingress

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg to ip-10-0-136-24.ec2.internal

openshift-ingress

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf to ip-10-0-136-24.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c801b865-5554f78b9c-grtds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c801b865-5554f78b9c-grtds to ip-10-0-128-117.ec2.internal

openshift-ingress

router-default-867b7bd764-5qsj7

Scheduled

Successfully assigned openshift-ingress/router-default-867b7bd764-5qsj7 to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 to ip-10-0-136-24.ec2.internal

openshift-ingress

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n to ip-10-0-131-207.ec2.internal

openshift-ingress

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt to ip-10-0-131-207.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-p5zcf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-p5zcf to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm to ip-10-0-131-207.ec2.internal

openshift-ingress

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr to ip-10-0-136-24.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp to ip-10-0-128-117.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6 to ip-10-0-131-207.ec2.internal

openshift-ingress

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq to ip-10-0-131-207.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc to ip-10-0-128-117.ec2.internal

openshift-ingress

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4 to ip-10-0-131-207.ec2.internal

openshift-ingress

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

Scheduled

Successfully assigned openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7 to ip-10-0-136-24.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs to ip-10-0-136-24.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-867b7bd764 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-867b7bd764

FailedCreate

Error creating: pods "router-default-867b7bd764-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-867b7bd764

FailedCreate

Error creating: pods "router-default-867b7bd764-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-867b7bd764

SuccessfulCreate

Created pod: router-default-867b7bd764-5qsj7

openshift-ingress

taint-eviction-controller

router-default-867b7bd764-5qsj7

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/router-default-867b7bd764-5qsj7
(x6)

openshift-ingress

kubelet

router-default-867b7bd764-5qsj7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-867b7bd764-5qsj7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-867b7bd764-5qsj7

Created

Created container: router

openshift-ingress

multus

router-default-867b7bd764-5qsj7

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-867b7bd764-5qsj7

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-867b7bd764-5qsj7

Started

Started container router

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-9dbml

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-ncf29

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-9b9df8cfb-ncf29

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-9b9df8cfb from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-9b9df8cfb

SuccessfulCreate

Created pod: kube-auth-proxy-9b9df8cfb-9dbml

openshift-ingress

replicaset-controller

kube-auth-proxy-9b9df8cfb

SuccessfulCreate

Created pod: kube-auth-proxy-9b9df8cfb-ncf29
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-9b9df8cfb

FailedCreate

Error creating: pods "kube-auth-proxy-9b9df8cfb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-9b9df8cfb-9dbml

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-p5zcf

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-p5zcf

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-p5zcf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-9dbml

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.109s (3.109s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-9dbml

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-9dbml

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-ncf29

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-ncf29

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9b9df8cfb-ncf29

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.108s (3.108s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-p5zcf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.295s (4.295s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-p5zcf

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-p5zcf

Created

Created container: discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6cbcdcfccc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6cbcdcfccc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.799s (2.799s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6cbcdcfcccmvrvp

Started

Started container istio-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-m8t9v

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-m8t9v

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m8t9v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m8t9v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.177s (2.177s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m8t9v

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m8t9v

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m8t9v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m8t9v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-p5zcf

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-p5zcf

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-c747fcbf8 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-c747fcbf8

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-c747fcbf8-xmtbs

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.989s (2.989s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-processing-5b54b7fbb7-chp7l

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-chp7l

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-xj6c6

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-chp7l

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-xj6c6

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xj6c6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xj6c6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.704s (1.704s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xj6c6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xj6c6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-chp7l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-chp7l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.371s (2.371s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-chp7l

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-c747fcbf8-xmtbs

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-c554db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c554db-openshift-default-7b4856b694 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-e49066-openshift-default-6d98b49bb

SuccessfulCreate

Created pod: e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

openshift-ingress

replicaset-controller

e2e-worker-w4-bc0270-openshift-default-76867bdd48

SuccessfulCreate

Created pod: e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

openshift-ingress

deployment-controller

e2e-inf-a-e49066-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e49066-openshift-default-6d98b49bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e49066

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e49066

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-c554db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-c554db

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-bc0270

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-bc0270

openshift-ingress

deployment-controller

e2e-worker-w4-bc0270-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-bc0270-openshift-default-76867bdd48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-c554db-openshift-default-7b4856b694

SuccessfulCreate

Created pod: e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

openshift-ingress

multus

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e49066-667c97cb85

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e49066-667c97cb85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e49066: serviceaccount "payload-processing-e2e-inf-a-e49066" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e49066

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e49066-667c97cb85 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e49066-6f8456d674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e49066-6f8456d674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e49066: serviceaccount "payload-processing-e2e-inf-a-e49066" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e49066-6f8456d674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e49066

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e49066-6f8456d674 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e49066-667c97cb85

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-c554db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-c554db-dc79f7886 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c554db-58d94969fc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-c554db-58d94969fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c554db: serviceaccount "payload-processing-e2e-worker-w0-c554db" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c554db-58d94969fc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-c554db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-c554db-58d94969fc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c554db: serviceaccount "payload-processing-e2e-worker-w0-c554db" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-bc0270

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-bc0270

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-bc0270-78cb846458 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-bc0270: serviceaccount "payload-processing-e2e-worker-w4-bc0270" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-bc0270: serviceaccount "payload-processing-e2e-worker-w4-bc0270" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-c801b865

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c801b865

openshift-ingress

deployment-controller

e2e-ait-c801b865-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c801b865-openshift-default-6d58b8df8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c801b865-openshift-default-6d58b8df8

SuccessfulCreate

Created pod: e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

openshift-ingress

multus

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4

SuccessfulCreate

Created pod: e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

openshift-ingress

deployment-controller

e2e-autores-a1e1f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a1e1f1-openshift-default-7df7f7b6b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-a1e1f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-a1e1f1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c801b865

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c801b865-bdf9bf8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c801b865

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c801b865-5554f78b9c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-c801b865-5554f78b9c-grtds

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c801b865: serviceaccount "payload-processing-e2e-ait-c801b865" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c801b865-5554f78b9c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c801b865-5554f78b9c-grtds
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c801b865-5554f78b9c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c801b865-5554f78b9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c801b865: serviceaccount "payload-processing-e2e-ait-c801b865" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-c801b865-5554f78b9c-grtds

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c801b865-5554f78b9c-grtds

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c801b865-5554f78b9c-grtds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-a1e1f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-a1e1f1-84fbf489f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a1e1f1: serviceaccount "payload-processing-e2e-autores-a1e1f1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a1e1f1-84fbf489f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-a1e1f1-84fbf489f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a1e1f1: serviceaccount "payload-processing-e2e-autores-a1e1f1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a1e1f1-84fbf489f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-a1e1f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

ProbeError

Readiness probe error: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-2a142a

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-2a142a-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-2a142a-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-b-2a142a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-2a142a

openshift-ingress

deployment-controller

e2e-inf-b-2a142a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-2a142a-openshift-default-6f97f8bb86 from 0 to 1

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

Unhealthy

Readiness probe failed: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-inf-b-2a142a-openshift-default-6f97f8bb86

SuccessfulCreate

Created pod: e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

openshift-ingress

multus

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2a142a-59fdd6c69c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2a142a-59fdd6c69c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-2a142a-59fdd6c69c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2a142a: serviceaccount "payload-processing-e2e-inf-b-2a142a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-2a142a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2a142a: serviceaccount "payload-processing-e2e-inf-b-2a142a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-2a142a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-2a142a-59fdd6c69c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-c801b865-openshift-default-6d58b8df8-x2c95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c801b865-bdf9bf8b-pjgmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c801b865-5554f78b9c-grtds

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-669203b2-gw-openshift-default-557946456

SuccessfulCreate

Created pod: e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

openshift-ingress

deployment-controller

e2e-migrate-669203b2-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-669203b2-gw-openshift-default-557946456 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-669203b2-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-669203b2-gw

openshift-ingress

multus

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-669203b2: serviceaccount "payload-processing-e2e-migrate-669203b2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-669203b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-669203b2-7c4f446654 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-669203b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-669203b2-77f96d9b54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-669203b2-7c4f446654

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68

openshift-ingress

multus

payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-669203b2-7c4f446654

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-669203b2-7c4f446654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-669203b2: serviceaccount "payload-processing-e2e-migrate-669203b2" not found
(x5)

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-669203b2-7c4f446654-xrg68

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-669203b2-77f96d9b54-94pks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-8ee5335d-openshift-default-6fcfb5b784

SuccessfulCreate

Created pod: e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

openshift-ingress

deployment-controller

e2e-ait-8ee5335d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8ee5335d-openshift-default-6fcfb5b784 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8ee5335d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8ee5335d

openshift-ingress

multus

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ee5335d-5c5558c8ff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8ee5335d-5c5558c8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ee5335d: serviceaccount "payload-processing-e2e-ait-8ee5335d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ee5335d-5c5558c8ff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8ee5335d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8ee5335d-5c5558c8ff from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ee5335d: serviceaccount "payload-processing-e2e-ait-8ee5335d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8ee5335d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ee5335d-fc7c8f9bb-xggcb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8ee5335d-5c5558c8ff-z2s4k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-8ee5335d-openshift-default-6fcfb5b784-gxdm7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-e3e6ebae-openshift-default-5964688b68

SuccessfulCreate

Created pod: e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

openshift-ingress

deployment-controller

e2e-derive-e3e6ebae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-e3e6ebae-openshift-default-5964688b68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-e3e6ebae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-e3e6ebae

openshift-ingress

multus

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e3e6ebae-6d499bd64f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e3e6ebae-6d499bd64f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-e3e6ebae-6d499bd64f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e3e6ebae: serviceaccount "payload-processing-e2e-derive-e3e6ebae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-e3e6ebae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-e3e6ebae-6d499bd64f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-e3e6ebae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e3e6ebae: serviceaccount "payload-processing-e2e-derive-e3e6ebae" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-a1e1f1-84fbf489f-tp28v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1e1f1-7c68b8cbdb-6b9fc

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ebae-6d499bd64f-ktshj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ebae-6b5546d6-q5qm4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-b402ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-b402ba

openshift-ingress

replicaset-controller

e2e-explicit-b402ba-openshift-default-f98698564

SuccessfulCreate

Created pod: e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

openshift-ingress

deployment-controller

e2e-explicit-b402ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-b402ba-openshift-default-f98698564 from 0 to 1

openshift-ingress

multus

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-a1e1f1-openshift-default-7df7f7b6b4-26v6n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-b402ba-669746769-ncr7s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-b402ba-669746769-ncr7s

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-b402ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-b402ba-5d46d5df54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b402ba-669746769

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-b402ba-669746769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b402ba: serviceaccount "payload-processing-e2e-explicit-b402ba" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b402ba-669746769

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-b402ba-669746769-ncr7s

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-b402ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-b402ba-669746769 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b402ba: serviceaccount "payload-processing-e2e-explicit-b402ba" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b402ba-669746769-ncr7s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b402ba-669746769-ncr7s

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-a5f6d9c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a5f6d9c8

openshift-ingress

deployment-controller

e2e-mt-a5f6d9c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d from 0 to 1

openshift-ingress

multus

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d

SuccessfulCreate

Created pod: e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

openshift-ingress

multus

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8

openshift-ingress

kubelet

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a5f6d9c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a5f6d9c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a5f6d9c8-6c5b85d969 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5f6d9c8: serviceaccount "payload-processing-e2e-mt-a5f6d9c8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5f6d9c8: serviceaccount "payload-processing-e2e-mt-a5f6d9c8" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b402ba-669746769-ncr7s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b402ba-5d46d5df54-9qcc2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-explicit-b402ba-openshift-default-f98698564-wv4kg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-db67bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-db67bc-openshift-default-588df66f5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-db67bc-openshift-default-588df66f5b

SuccessfulCreate

Created pod: e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv

openshift-ingress

gateway_labeler_controller

e2e-noten-db67bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-db67bc

openshift-ingress

multus

e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-a5f6d9c8-6c5b85d969-9vbn8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5f6d9c8-6d7f75ff54-5kbct

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb

SuccessfulCreate

Created pod: e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

openshift-ingress

deployment-controller

e2e-shared-a-w2-d1f639-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-d1f639-openshift-default-95d978cfb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-d1f639

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-d1f639

openshift-ingress

multus

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d1f639-55786b46c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-d1f639-55786b46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d1f639: serviceaccount "payload-processing-e2e-shared-a-w2-d1f639" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d1f639: serviceaccount "payload-processing-e2e-shared-a-w2-d1f639" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-d1f639

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d1f639-55786b46c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-d1f639

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-d1f639-55786b46c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-4ec60c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4ec60c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4ec60c

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6

SuccessfulCreate

Created pod: e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4ec60c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4ec60c: serviceaccount "payload-processing-e2e-shared-b-w2-4ec60c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4ec60c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4ec60c: serviceaccount "payload-processing-e2e-shared-b-w2-4ec60c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e49066-667c97cb85-w4rwx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e49066-6f8456d674-t8lt2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-24ec44a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-24ec44a5

openshift-ingress

kubelet

e2e-noten-db67bc-openshift-default-588df66f5b-vp6vv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-24ec44a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-24ec44a5-openshift-default-6bb5597cfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-24ec44a5-openshift-default-6bb5597cfb

SuccessfulCreate

Created pod: e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

openshift-ingress

multus

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-24ec44a5-b999c76b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-24ec44a5-b999c76b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-24ec44a5: serviceaccount "payload-processing-e2e-mt-24ec44a5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-24ec44a5-74dff89646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-24ec44a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-24ec44a5-b999c76b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-24ec44a5-b999c76b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-24ec44a5-74dff89646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-24ec44a5-74dff89646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-24ec44a5: serviceaccount "payload-processing-e2e-mt-24ec44a5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-24ec44a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-24ec44a5-74dff89646 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2a142a-59fdd6c69c-2lp2f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2a142a-7ddb49fccd-79vt9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-679f45-openshift-default-84696cbc98

SuccessfulCreate

Created pod: e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-679f45

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-679f45

openshift-ingress

deployment-controller

e2e-shared-a-w3-679f45-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-679f45-openshift-default-84696cbc98 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-2a142a-openshift-default-6f97f8bb86-jnqqb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-679f45

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-679f45-567b778474 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-679f45

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-679f45: serviceaccount "payload-processing-e2e-shared-a-w3-679f45" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-679f45: serviceaccount "payload-processing-e2e-shared-a-w3-679f45" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm

Created

Created container: payload-processing

openshift-ingress

multus

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874

SuccessfulCreate

Created pod: e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

openshift-ingress

deployment-controller

e2e-shared-b-w3-cfcdfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-cfcdfd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-cfcdfd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-cfcdfd: serviceaccount "payload-processing-e2e-shared-b-w3-cfcdfd" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:51792->10.132.0.64:15021: read: connection reset by peer body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-cfcdfd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-cfcdfd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-cfcdfd: serviceaccount "payload-processing-e2e-shared-b-w3-cfcdfd" not found

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:51792->10.132.0.64:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-24ec44a5-b999c76b5-x48bp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-24ec44a5-74dff89646-nf4f4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c554db-dc79f7886-zp7bl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c554db-58d94969fc-vkhrp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-c554db-openshift-default-7b4856b694-gwtgt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-364341

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-364341

openshift-ingress

deployment-controller

e2e-api-a-364341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-364341-openshift-default-774b4b4c54 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-364341-openshift-default-774b4b4c54

SuccessfulCreate

Created pod: e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

openshift-ingress

multus

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-364341-8694679854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb

openshift-ingress

multus

payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-364341-8694679854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-364341-8694679854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-364341: serviceaccount "payload-processing-e2e-api-a-364341" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-364341

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-364341-8694679854 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-364341

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-364341-84cfbf64b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-364341-84cfbf64b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-364341-84cfbf64b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-364341-84cfbf64b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-364341: serviceaccount "payload-processing-e2e-api-a-364341" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-59ce1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-59ce1d

openshift-ingress

multus

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd

SuccessfulCreate

Created pod: e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

openshift-ingress

deployment-controller

e2e-api-b-59ce1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-59ce1d-openshift-default-7c7f8db7bd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-59ce1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-59ce1d-754cd7ff87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp

openshift-ingress

multus

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-59ce1d: serviceaccount "payload-processing-e2e-api-b-59ce1d" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-59ce1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-59ce1d-8659fd7478 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-59ce1d-754cd7ff87

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-59ce1d-754cd7ff87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-59ce1d: serviceaccount "payload-processing-e2e-api-b-59ce1d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-59ce1d-754cd7ff87

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9
(x2)

openshift-ingress

kubelet

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-364341-8694679854-rkbzb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-364341-84cfbf64b9-ff8s6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-364341-openshift-default-774b4b4c54-gfhkj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-59ce1d-754cd7ff87-96gz9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59ce1d-8659fd7478-m9kcp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-59ce1d-openshift-default-7c7f8db7bd-th59v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1f639-5dc57984f4-qnvqv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1f639-55786b46c-rvrxm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-shared-a-w2-d1f639

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-shared-a-w2-d1f639: Operation cannot be fulfilled on endpoints "payload-processing-e2e-shared-a-w2-d1f639": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-shared-a-w2-d1f639, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 29ddf9a9-9caf-4bac-9927-fa460917ddca, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4ec60c-67f54c848b-cds6h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4ec60c-dfdc4dc57-tq28z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-bc0270-6cd7cc84dc-8szsc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-bc0270-78cb846458-lf625

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-232ce2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-232ce2

openshift-ingress

deployment-controller

e2e-ipp-a-232ce2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-232ce2-openshift-default-7dddbfb95b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b

SuccessfulCreate

Created pod: e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

openshift-ingress

multus

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-232ce2: serviceaccount "payload-processing-e2e-ipp-a-232ce2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-232ce2-8d75f8f87

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-232ce2-8d75f8f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-232ce2: serviceaccount "payload-processing-e2e-ipp-a-232ce2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-232ce2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-232ce2-8d75f8f87 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-232ce2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-232ce2-8d75f8f87

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": read tcp 10.134.0.2:52974->10.134.0.82:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": read tcp 10.134.0.2:52974->10.134.0.82:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8ec58b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8ec58b

openshift-ingress

deployment-controller

e2e-ipp-b-8ec58b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8ec58b-openshift-default-ddb498d5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d

SuccessfulCreate

Created pod: e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

openshift-ingress

multus

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8ec58b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8ec58b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8ec58b-99488889d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8ec58b: serviceaccount "payload-processing-e2e-ipp-b-8ec58b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8ec58b: serviceaccount "payload-processing-e2e-ipp-b-8ec58b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-330769

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-330769

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

openshift-ingress

deployment-controller

e2e-ipp-cleanup-330769-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-330769-openshift-default-bf765f5b8 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-330769-67876799f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-330769

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-330769-67876799f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-330769-67876799f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-330769-67876799f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-330769: serviceaccount "payload-processing-e2e-ipp-cleanup-330769" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-330769: serviceaccount "payload-processing-e2e-ipp-cleanup-330769" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-330769

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-330769-67876799f-dm5r4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-330769-6d9db4db58-xzhd4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-232ce2-8d75f8f87-rv89z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-232ce2-65b9c597c8-qg86t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8ec58b-7564bc5f7c-xrvg2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8ec58b-99488889d-qsfgw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8ec58b-openshift-default-ddb498d5d-nhcrq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-679f45-5bf7fc749c-69rpm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-679f45-567b778474-x7n4p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-679f45-openshift-default-84696cbc98-gklj4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cfcdfd-5445b654d5-984kx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cfcdfd-896fb84d6-v7psx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-cfcdfd-openshift-default-85f76bb874-9cb7r

Killing

Stopping container istio-proxy