Time Namespace Component RelatedObject Reason Message

openshift-ingress

router-default-5fb8d9b79d-nxqx6

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a649773d-5db8b5677c-kj498

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a649773d-5db8b5677c-kj498 to ip-10-0-136-35.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-4s7cw

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-4s7cw to ip-10-0-136-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4 to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t to ip-10-0-136-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc to ip-10-0-136-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6 to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2 to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p to ip-10-0-135-192.ec2.internal

openshift-ingress

router-default-5fb8d9b79d-nxqx6

Scheduled

Successfully assigned openshift-ingress/router-default-5fb8d9b79d-nxqx6 to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss to ip-10-0-136-35.ec2.internal

openshift-ingress

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2 to ip-10-0-135-192.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4 to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

Scheduled

Successfully assigned openshift-ingress/e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549 to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp to ip-10-0-136-35.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-mz5t5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-mz5t5 to ip-10-0-136-35.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-dldkt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dldkt to ip-10-0-136-35.ec2.internal

openshift-ingress

payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8 to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-71c181-openshift-default-5b75999664-9s7bz to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg to ip-10-0-129-84.ec2.internal

openshift-ingress

payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp to ip-10-0-129-84.ec2.internal

openshift-ingress

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj to ip-10-0-135-192.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-nd4b5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5 to ip-10-0-135-192.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-c8m6s

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c8m6s to ip-10-0-136-35.ec2.internal

openshift-ingress

payload-processing-e2e-autores-71c181-9448f866c-4p6s9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-71c181-9448f866c-4p6s9 to ip-10-0-129-84.ec2.internal

openshift-ingress

kube-auth-proxy-595c6d67d9-zbpjd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-595c6d67d9-zbpjd to ip-10-0-129-84.ec2.internal

openshift-ingress

kube-auth-proxy-595c6d67d9-p8vtt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-595c6d67d9-p8vtt to ip-10-0-136-35.ec2.internal

openshift-ingress

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx to ip-10-0-135-192.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5fb8d9b79d from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-5fb8d9b79d

FailedCreate

Error creating: pods "router-default-5fb8d9b79d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5fb8d9b79d

FailedCreate

Error creating: pods "router-default-5fb8d9b79d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-5fb8d9b79d

SuccessfulCreate

Created pod: router-default-5fb8d9b79d-nxqx6
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-5fb8d9b79d-nxqx6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x7)

openshift-ingress

kubelet

router-default-5fb8d9b79d-nxqx6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5fb8d9b79d-nxqx6

Started

Started container router

openshift-ingress

kubelet

router-default-5fb8d9b79d-nxqx6

Created

Created container: router

openshift-ingress

kubelet

router-default-5fb8d9b79d-nxqx6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-5fb8d9b79d-nxqx6

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-595c6d67d9

SuccessfulCreate

Created pod: kube-auth-proxy-595c6d67d9-zbpjd

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-595c6d67d9 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-595c6d67d9

SuccessfulCreate

Created pod: kube-auth-proxy-595c6d67d9-p8vtt
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-595c6d67d9

FailedCreate

Error creating: pods "kube-auth-proxy-595c6d67d9-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-595c6d67d9-zbpjd

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-p8vtt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-595c6d67d9-p8vtt

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-zbpjd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-c8m6s

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-c8m6s

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c8m6s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-zbpjd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.739s (2.739s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-zbpjd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-zbpjd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-p8vtt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-p8vtt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-595c6d67d9-p8vtt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.658s (4.658s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c8m6s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.691s (3.691s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c8m6s

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c8m6s

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-nd4b5

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nd4b5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c8m6s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c8m6s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-nd4b5

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nd4b5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.304s (2.304s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nd4b5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nd4b5

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-c8m6s

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-c8m6s

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.474s (4.474s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vtvmn

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-dldkt

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dldkt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-dldkt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dldkt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.075s (3.075s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-4s7cw

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4s7cw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-4s7cw

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-mz5t5

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mz5t5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-mz5t5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mz5t5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.947s (2.947s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4s7cw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.907s (2.907s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4s7cw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4s7cw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mz5t5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mz5t5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dldkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dldkt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dldkt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dldkt

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-dldkt

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-4f59a0-openshift-default-5757654bd8

SuccessfulCreate

Created pod: e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4f59a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4f59a0

openshift-ingress

deployment-controller

e2e-inf-a-4f59a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4f59a0-openshift-default-5757654bd8 from 0 to 1

openshift-ingress

multus

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4f59a0-64bd959987

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4f59a0-64bd959987

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4f59a0-64bd959987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4f59a0: serviceaccount "payload-processing-e2e-inf-a-4f59a0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4f59a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4f59a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4f59a0-64bd959987 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4f59a0: serviceaccount "payload-processing-e2e-inf-a-4f59a0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.775s (1.775s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-ait-a649773d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a649773d-openshift-default-7ccdffd898 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a649773d-openshift-default-7ccdffd898

SuccessfulCreate

Created pod: e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

openshift-ingress

gateway_labeler_controller

e2e-ait-a649773d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a649773d

openshift-ingress

multus

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-71c181-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-71c181-openshift-default-5b75999664 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-71c181

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-71c181

openshift-ingress

replicaset-controller

e2e-autores-71c181-openshift-default-5b75999664

SuccessfulCreate

Created pod: e2e-autores-71c181-openshift-default-5b75999664-9s7bz

openshift-ingress

multus

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a649773d-5db8b5677c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a649773d-5db8b5677c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a649773d: serviceaccount "payload-processing-e2e-ait-a649773d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a649773d: serviceaccount "payload-processing-e2e-ait-a649773d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a649773d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a649773d-6fbc965d7d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a649773d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a649773d-5db8b5677c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a649773d-5db8b5677c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a649773d-5db8b5677c-kj498

openshift-ingress

multus

payload-processing-e2e-ait-a649773d-5db8b5677c-kj498

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a649773d-5db8b5677c-kj498

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a649773d-5db8b5677c-kj498

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a649773d-5db8b5677c-kj498

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-71c181

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-71c181-9448f866c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-71c181-9448f866c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-71c181-9448f866c-4p6s9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-71c181-8cf76b9c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-71c181-8cf76b9c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-71c181: serviceaccount "payload-processing-e2e-autores-71c181" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-71c181-8cf76b9c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87

openshift-ingress

multus

payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-71c181-9448f866c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-71c181-9448f866c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-71c181: serviceaccount "payload-processing-e2e-autores-71c181" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-71c181

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-71c181-8cf76b9c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-71c181-9448f866c-4p6s9

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-71c181-9448f866c-4p6s9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

ProbeError

Readiness probe error: Get "http://10.132.0.31:15021/healthz/ready": read tcp 10.132.0.2:47530->10.132.0.31:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

Unhealthy

Readiness probe failed: Get "http://10.132.0.31:15021/healthz/ready": read tcp 10.132.0.2:47530->10.132.0.31:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-processing-e2e-autores-71c181-9448f866c-4p6s9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-71c181-9448f866c-4p6s9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.2s (2.2s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-71c181-9448f866c-4p6s9

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-093e38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-093e38

openshift-ingress

multus

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-093e38-openshift-default-6684f58bd

SuccessfulCreate

Created pod: e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

openshift-ingress

deployment-controller

e2e-inf-b-093e38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-093e38-openshift-default-6684f58bd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-093e38-7df48679ff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-093e38-7df48679ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-093e38: serviceaccount "payload-processing-e2e-inf-b-093e38" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-093e38-7df48679ff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-093e38: serviceaccount "payload-processing-e2e-inf-b-093e38" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-093e38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-093e38-7f5d966c54 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-093e38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-093e38-7df48679ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-a649773d-5db8b5677c-kj498

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a649773d-6fbc965d7d-jv7gp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-a649773d-openshift-default-7ccdffd898-prvp4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-219dfd41-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-219dfd41-gw

openshift-ingress

replicaset-controller

e2e-migrate-219dfd41-gw-openshift-default-c647446d8

SuccessfulCreate

Created pod: e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

openshift-ingress

deployment-controller

e2e-migrate-219dfd41-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-219dfd41-gw-openshift-default-c647446d8 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-219dfd41: serviceaccount "payload-processing-e2e-migrate-219dfd41" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-219dfd41-645fc8b998

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-219dfd41-645fc8b998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-219dfd41: serviceaccount "payload-processing-e2e-migrate-219dfd41" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-219dfd41-645fc8b998

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-219dfd41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-219dfd41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-219dfd41-645fc8b998 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-219dfd41-gw-openshift-default-c647446d8-hsgss

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-219dfd41

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-219dfd41: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-219dfd41": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-219dfd41, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: beeabff9-ff1c-4abd-bdfd-95d553edc187, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-219dfd41-6dbd9d6574-np79g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-a9bbeff1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a9bbeff1

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-ait-a9bbeff1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a9bbeff1-openshift-default-65b5cc44fb from 0 to 1

openshift-ingress

multus

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb

SuccessfulCreate

Created pod: e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3s (3s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a9bbeff1-f747c59f5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a9bbeff1-f747c59f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a9bbeff1: serviceaccount "payload-processing-e2e-ait-a9bbeff1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a9bbeff1-f747c59f5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a9bbeff1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a9bbeff1-f747c59f5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a9bbeff1: serviceaccount "payload-processing-e2e-ait-a9bbeff1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a9bbeff1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-4ecd209d-openshift-default-75df7c88d8

SuccessfulCreate

Created pod: e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

openshift-ingress

deployment-controller

e2e-derive-4ecd209d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-4ecd209d-openshift-default-75df7c88d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-4ecd209d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-4ecd209d

openshift-ingress

multus

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-4ecd209d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-4ecd209d-66d5b677c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4ecd209d-798c694874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-4ecd209d-798c694874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4ecd209d: serviceaccount "payload-processing-e2e-derive-4ecd209d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4ecd209d-66d5b677c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4ecd209d-66d5b677c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-4ecd209d-66d5b677c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4ecd209d: serviceaccount "payload-processing-e2e-derive-4ecd209d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4ecd209d-798c694874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-4ecd209d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-4ecd209d-798c694874 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-autores-71c181-9448f866c-4p6s9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-c5f375

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c5f375

openshift-ingress

deployment-controller

e2e-explicit-c5f375-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c5f375-openshift-default-d55b7b76d from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-c5f375-openshift-default-d55b7b76d

SuccessfulCreate

Created pod: e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

openshift-ingress

kubelet

e2e-autores-71c181-openshift-default-5b75999664-9s7bz

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c5f375-8598dfd9c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c5f375-8598dfd9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c5f375: serviceaccount "payload-processing-e2e-explicit-c5f375" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c5f375-8598dfd9c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c5f375

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c5f375-8598dfd9c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c5f375-5596d6598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c5f375-5596d6598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c5f375: serviceaccount "payload-processing-e2e-explicit-c5f375" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c5f375-5596d6598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c5f375

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c5f375-5596d6598 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-905b058d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-905b058d

openshift-ingress

deployment-controller

e2e-mt-905b058d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-905b058d-openshift-default-5676dddd6d from 0 to 1

openshift-ingress

multus

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-905b058d-openshift-default-5676dddd6d

SuccessfulCreate

Created pod: e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-905b058d-776879fffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-905b058d-776879fffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-905b058d: serviceaccount "payload-processing-e2e-mt-905b058d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-905b058d-677cc4f79c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-905b058d-677cc4f79c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-905b058d: serviceaccount "payload-processing-e2e-mt-905b058d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-905b058d-677cc4f79c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8

openshift-ingress

deployment-controller

payload-processing-e2e-mt-905b058d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-905b058d-677cc4f79c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-905b058d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-905b058d-776879fffd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-905b058d-776879fffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4f59a0-6dc6d8758-8g6cc

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-4f59a0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-4f59a0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-4f59a0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-4f59a0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d72371ae-9e31-48b0-9965-e3b0f01a5d82, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c5f375-5596d6598-8hhv6

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-4f59a0-openshift-default-5757654bd8-2rcnh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-c9dd9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c9dd9a

openshift-ingress

replicaset-controller

e2e-noten-c9dd9a-openshift-default-6cb99556b4

SuccessfulCreate

Created pod: e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549

openshift-ingress

deployment-controller

e2e-noten-c9dd9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c9dd9a-openshift-default-6cb99556b4 from 0 to 1

openshift-ingress

kubelet

e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-093e38-7f5d966c54-jxf7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-905b058d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-905b058d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-905b058d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-905b058d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1c277aaa-95b3-4744-add7-3dbc218ab56d, UID in object meta:

openshift-ingress

kubelet

e2e-inf-b-093e38-openshift-default-6684f58bd-zc4nl

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-8f2df2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-8f2df2

openshift-ingress

multus

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-8f2df2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856

SuccessfulCreate

Created pod: e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

openshift-ingress

kubelet

e2e-mt-905b058d-openshift-default-5676dddd6d-5fmww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8f2df2: serviceaccount "payload-processing-e2e-shared-a-w3-8f2df2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-8f2df2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-8f2df2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8f2df2: serviceaccount "payload-processing-e2e-shared-a-w3-8f2df2" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-b5cba4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b5cba4

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": read tcp 10.134.0.2:57866->10.134.0.46:15021: read: connection reset by peer

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4

SuccessfulCreate

Created pod: e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

openshift-ingress

deployment-controller

e2e-shared-a-w2-b5cba4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": read tcp 10.134.0.2:57866->10.134.0.46:15021: read: connection reset by peer body:

openshift-ingress

multus

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-c9dd9a-openshift-default-6cb99556b4-kn549

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-b5cba4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4: serviceaccount "payload-processing-e2e-shared-a-w2-b5cba4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-b5cba4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4: serviceaccount "payload-processing-e2e-shared-a-w2-b5cba4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd

SuccessfulCreate

Created pod: e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

openshift-ingress

deployment-controller

e2e-shared-b-w3-df48ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-df48ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-df48ae

openshift-ingress

multus

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-df48ae: serviceaccount "payload-processing-e2e-shared-b-w3-df48ae" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-df48ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-df48ae: serviceaccount "payload-processing-e2e-shared-b-w3-df48ae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-df48ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-df48ae-6db675bc85 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": read tcp 10.132.0.2:38220->10.132.0.57:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": read tcp 10.132.0.2:38220->10.132.0.57:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474

SuccessfulCreate

Created pod: e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

openshift-ingress

deployment-controller

e2e-shared-b-w2-6a7dbc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-6a7dbc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-6a7dbc

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc: serviceaccount "payload-processing-e2e-shared-b-w2-6a7dbc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-6a7dbc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-6a7dbc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc: serviceaccount "payload-processing-e2e-shared-b-w2-6a7dbc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-638c40f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-638c40f1-openshift-default-7bb7fd978d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-638c40f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-638c40f1

openshift-ingress

replicaset-controller

e2e-mt-638c40f1-openshift-default-7bb7fd978d

SuccessfulCreate

Created pod: e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

openshift-ingress

multus

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-638c40f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-638c40f1-55b9bc88bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-638c40f1-55b9bc88bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-638c40f1-55b9bc88bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-638c40f1: serviceaccount "payload-processing-e2e-mt-638c40f1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-638c40f1: serviceaccount "payload-processing-e2e-mt-638c40f1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-638c40f1-55b9bc88bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-638c40f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-638c40f1-55b9bc88bf-lzxlp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-638c40f1-5dcf8b878b-lh27f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-464c54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-464c54-openshift-default-cd7bb88cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-464c54-openshift-default-cd7bb88cb

SuccessfulCreate

Created pod: e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

openshift-ingress

gateway_labeler_controller

e2e-api-a-464c54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-464c54
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-464c54-796b584bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-464c54-796b584bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-464c54: serviceaccount "payload-processing-e2e-api-a-464c54" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-464c54-674979dfc9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-464c54-674979dfc9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-464c54-674979dfc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-464c54: serviceaccount "payload-processing-e2e-api-a-464c54" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-464c54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-464c54-674979dfc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-464c54-796b584bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-464c54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-464c54-796b584bcd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-4bfe1d-openshift-default-59f779fc9d

SuccessfulCreate

Created pod: e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

openshift-ingress

gateway_labeler_controller

e2e-api-b-4bfe1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4bfe1d

openshift-ingress

deployment-controller

e2e-api-b-4bfe1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4bfe1d-openshift-default-59f779fc9d from 0 to 1

openshift-ingress

multus

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4bfe1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4bfe1d-86c6bd564f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4bfe1d-86c6bd564f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4bfe1d-86c6bd564f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4bfe1d: serviceaccount "payload-processing-e2e-api-b-4bfe1d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4bfe1d: serviceaccount "payload-processing-e2e-api-b-4bfe1d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4bfe1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4bfe1d-86c6bd564f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-464c54-674979dfc9-bxqrl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-464c54-796b584bcd-qjlx2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-4bfe1d-openshift-default-59f779fc9d-w6rj4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-b5cba4-openshift-default-57fb6bbdb4-qzsvd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-6a7dbc-openshift-default-5df4d6474-zwlsm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-8349bf-openshift-default-86f4cf468b

SuccessfulCreate

Created pod: e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

openshift-ingress

deployment-controller

e2e-ipp-a-8349bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8349bf-openshift-default-86f4cf468b from 0 to 1

openshift-ingress

multus

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8349bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8349bf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8349bf-64b7856589

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8349bf-64b7856589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8349bf: serviceaccount "payload-processing-e2e-ipp-a-8349bf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8349bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8349bf: serviceaccount "payload-processing-e2e-ipp-a-8349bf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8349bf-64b7856589

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8349bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8349bf-64b7856589 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": read tcp 10.134.0.2:51480->10.134.0.60:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": read tcp 10.134.0.2:51480->10.134.0.60:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-3691cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-3691cf-openshift-default-79bcf64c76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-3691cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3691cf

openshift-ingress

replicaset-controller

e2e-ipp-b-3691cf-openshift-default-79bcf64c76

SuccessfulCreate

Created pod: e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

openshift-ingress

multus

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3691cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3691cf: serviceaccount "payload-processing-e2e-ipp-b-3691cf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3691cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3691cf-54b4d7895f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3691cf-54b4d7895f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3691cf-54b4d7895f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3691cf-54b4d7895f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3691cf: serviceaccount "payload-processing-e2e-ipp-b-3691cf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b2555b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b2555b

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b2555b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b2555b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b2555b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b2555b: serviceaccount "payload-processing-e2e-ipp-cleanup-b2555b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b2555b: serviceaccount "payload-processing-e2e-ipp-cleanup-b2555b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2555b-5dd7676f6f-7pwdp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3691cf-54b4d7895f-s6wnm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-3691cf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-3691cf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-3691cf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-3691cf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c5e97853-e000-4eda-8fb1-886569aa4900, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3691cf-6899df46d6-knfnv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-3691cf-openshift-default-79bcf64c76-5qhqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8f2df2-7ff596d467-9dtrf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-df48ae-6db675bc85-fgvdc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-df48ae-openshift-default-6bf9cf46cd-hdpsg

Killing

Stopping container istio-proxy