Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c

Scheduled

Successfully assigned openshift-ingress/e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c to ip-10-0-135-133.ec2.internal

openshift-ingress

router-default-5c84486586-ftqpb

Scheduled

Successfully assigned openshift-ingress/router-default-5c84486586-ftqpb to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d to ip-10-0-136-69.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2 to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9 to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89 to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9 to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn to ip-10-0-141-71.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-2gf9z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-2gf9z to ip-10-0-141-71.ec2.internal

openshift-ingress

kube-auth-proxy-5564d7bb97-sg8nb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb to ip-10-0-136-69.ec2.internal

openshift-ingress

kube-auth-proxy-5564d7bb97-8d97v

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5564d7bb97-8d97v to ip-10-0-135-133.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-hgjd9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hgjd9 to ip-10-0-135-133.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-tnjdk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-tnjdk to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx to ip-10-0-135-133.ec2.internal

openshift-ingress

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-57lf9

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-57lf9 to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6 to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp to ip-10-0-136-69.ec2.internal

openshift-ingress

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6 to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4 to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-m785w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-m785w to ip-10-0-136-69.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2 to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85 to ip-10-0-136-69.ec2.internal

openshift-ingress

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-78e0f8-openshift-default-65f487984-8bqns to ip-10-0-135-133.ec2.internal

openshift-ingress

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7 to ip-10-0-135-133.ec2.internal

openshift-ingress

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5 to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47 to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224 to ip-10-0-136-69.ec2.internal

openshift-ingress

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd to ip-10-0-136-69.ec2.internal

openshift-ingress

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997 to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp to ip-10-0-136-69.ec2.internal

openshift-ingress

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz to ip-10-0-136-69.ec2.internal

openshift-ingress

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

Scheduled

Successfully assigned openshift-ingress/e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2 to ip-10-0-135-133.ec2.internal

openshift-ingress

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7 to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g to ip-10-0-141-71.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw to ip-10-0-136-69.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d to ip-10-0-141-71.ec2.internal

openshift-ingress

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh to ip-10-0-135-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb to ip-10-0-136-69.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5c84486586 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-5c84486586

FailedCreate

Error creating: pods "router-default-5c84486586-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-5c84486586

FailedCreate

Error creating: pods "router-default-5c84486586-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5c84486586

SuccessfulCreate

Created pod: router-default-5c84486586-ftqpb
(x6)

openshift-ingress

kubelet

router-default-5c84486586-ftqpb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5c84486586-ftqpb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5c84486586-ftqpb

Started

Started container router

openshift-ingress

kubelet

router-default-5c84486586-ftqpb

Created

Created container: router

openshift-ingress

kubelet

router-default-5c84486586-ftqpb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-5c84486586-ftqpb

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5564d7bb97

SuccessfulCreate

Created pod: kube-auth-proxy-5564d7bb97-8d97v

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-8d97v

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5564d7bb97

SuccessfulCreate

Created pod: kube-auth-proxy-5564d7bb97-sg8nb
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5564d7bb97

FailedCreate

Error creating: pods "kube-auth-proxy-5564d7bb97-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5564d7bb97 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-sg8nb

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-5564d7bb97-sg8nb

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5564d7bb97-8d97v

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-8d97v

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-sg8nb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-hgjd9

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hgjd9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-hgjd9

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-sg8nb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-sg8nb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.668s (2.668s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-8d97v

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-8d97v

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-8d97v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.667s (2.667s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5564d7bb97-sg8nb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hgjd9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.644s (3.644s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hgjd9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hgjd9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hgjd9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hgjd9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.516s (2.516s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cbb5b2

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.954s (4.954s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

Started

Started container istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-tnjdk

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-7dn7l

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tnjdk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-tnjdk

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tnjdk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.255s (2.255s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tnjdk

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tnjdk

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-hgjd9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hgjd9

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-2gf9z

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-2gf9z

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-57lf9

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-m785w
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-57lf9

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-m785w

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-m785w

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-57lf9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-m785w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-m785w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-m785w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.44s (1.44s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-57lf9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-57lf9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-57lf9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.275s (1.275s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2gf9z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2gf9z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2gf9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2gf9z

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-2gf9z

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1a1e3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1a1e3a

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-db06d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-db06d6

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-83ba87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-83ba87

openshift-ingress

deployment-controller

e2e-worker-w0-db06d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-db06d6-openshift-default-58f5dff6c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6

SuccessfulCreate

Created pod: e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

openshift-ingress

multus

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-83ba87-openshift-default-8f9947d4b

SuccessfulCreate

Created pod: e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

openshift-ingress

deployment-controller

e2e-worker-w4-83ba87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-83ba87-openshift-default-8f9947d4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-1a1e3a-openshift-default-64969f57f8

SuccessfulCreate

Created pod: e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

openshift-ingress

deployment-controller

e2e-inf-a-1a1e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1a1e3a-openshift-default-64969f57f8 from 0 to 1

openshift-ingress

multus

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-db06d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-db06d6-65cdc768c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-db06d6: serviceaccount "payload-processing-e2e-worker-w0-db06d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-db06d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-db06d6-65cdc768c5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-db06d6-65cdc768c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-db06d6: serviceaccount "payload-processing-e2e-worker-w0-db06d6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-db06d6-65cdc768c5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-83ba87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-83ba87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-83ba87-86f9b57c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-83ba87: serviceaccount "payload-processing-e2e-worker-w4-83ba87" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-83ba87-86f9b57c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-83ba87-86f9b57c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-83ba87: serviceaccount "payload-processing-e2e-worker-w4-83ba87" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-83ba87-86f9b57c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5

openshift-ingress

replicaset-controller

e2e-autores-1e9b41-openshift-default-65f7b545f8

SuccessfulCreate

Created pod: e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

openshift-ingress

gateway_labeler_controller

e2e-autores-1e9b41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-1e9b41

openshift-ingress

GatewayAuthBootstrap

e2e-autores-1e9b41

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-1e9b41-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-1e9b41-authn-ssl" already exists

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-1e9b41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-1e9b41-openshift-default-65f7b545f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1a1e3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc from 0 to 1

openshift-ingress

multus

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1a1e3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1a1e3a: serviceaccount "payload-processing-e2e-inf-a-1a1e3a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1a1e3a: serviceaccount "payload-processing-e2e-inf-a-1a1e3a" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz

Started

Started container payload-processing

openshift-ingress

multus

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-5b37c5b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5b37c5b2

openshift-ingress

deployment-controller

e2e-ait-5b37c5b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5b37c5b2-openshift-default-66f9f46666 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-5b37c5b2-openshift-default-66f9f46666

SuccessfulCreate

Created pod: e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1e9b41-69ddb96749

FailedCreate

Error creating: pods "payload-processing-e2e-autores-1e9b41-69ddb96749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1e9b41: serviceaccount "payload-processing-e2e-autores-1e9b41" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1e9b41-69ddb96749

SuccessfulCreate

Created pod: payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn

openshift-ingress

deployment-controller

payload-processing-e2e-autores-1e9b41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-1e9b41-69ddb96749 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1e9b41: serviceaccount "payload-processing-e2e-autores-1e9b41" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-1e9b41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-1e9b41-97fffb6c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5b37c5b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5b37c5b2-7479bf4469 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5b37c5b2-7479bf4469

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5b37c5b2-7479bf4469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5b37c5b2: serviceaccount "payload-processing-e2e-ait-5b37c5b2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5b37c5b2-7479bf4469

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5b37c5b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5b37c5b2: serviceaccount "payload-processing-e2e-ait-5b37c5b2" not found

openshift-ingress

multus

payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-02c60f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-02c60f

openshift-ingress

multus

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-02c60f-openshift-default-848bdbd574

SuccessfulCreate

Created pod: e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

openshift-ingress

deployment-controller

e2e-inf-b-02c60f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-02c60f-openshift-default-848bdbd574 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-02c60f-7864c8846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-02c60f-7864c8846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-02c60f: serviceaccount "payload-processing-e2e-inf-b-02c60f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-02c60f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-02c60f-7864c8846 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-02c60f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-02c60f-758b48cb45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-02c60f-758b48cb45

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-02c60f-7864c8846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-02c60f-758b48cb45

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-02c60f-758b48cb45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-02c60f: serviceaccount "payload-processing-e2e-inf-b-02c60f" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b37c5b2-5c5bf948c4-2tc5c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-5b37c5b2-openshift-default-66f9f46666-l68b9

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-migrate-d3e394ce-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d3e394ce-gw

openshift-ingress

deployment-controller

e2e-migrate-d3e394ce-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd

SuccessfulCreate

Created pod: e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

openshift-ingress

multus

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d3e394ce-68d8d987db

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d3e394ce-68d8d987db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d3e394ce: serviceaccount "payload-processing-e2e-migrate-d3e394ce" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d3e394ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d3e394ce-68d8d987db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d3e394ce: serviceaccount "payload-processing-e2e-migrate-d3e394ce" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d3e394ce-68d8d987db

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d3e394ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3e394ce-5b867cfcc8-9hzz9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-b0bde17e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b0bde17e-openshift-default-866bc5bd8d from 0 to 1

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-d3e394ce-gw-openshift-default-7f6dbc6ddd-6kml7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ait-b0bde17e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b0bde17e

openshift-ingress

replicaset-controller

e2e-ait-b0bde17e-openshift-default-866bc5bd8d

SuccessfulCreate

Created pod: e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

openshift-ingress

multus

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b0bde17e-7986c96954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b0bde17e-7986c96954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b0bde17e: serviceaccount "payload-processing-e2e-ait-b0bde17e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b0bde17e: serviceaccount "payload-processing-e2e-ait-b0bde17e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b0bde17e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b0bde17e-84cdfc8c7f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b0bde17e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b0bde17e-7986c96954 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b0bde17e-7986c96954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk

openshift-ingress

multus

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-0cd86cdc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0cd86cdc

openshift-ingress

replicaset-controller

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b

SuccessfulCreate

Created pod: e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

openshift-ingress

deployment-controller

e2e-derive-0cd86cdc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0cd86cdc-openshift-default-6bb787cd5b from 0 to 1

openshift-ingress

multus

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-b0bde17e-openshift-default-866bc5bd8d-5pjnv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0cd86cdc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0cd86cdc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0cd86cdc-7f79688fd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0cd86cdc: serviceaccount "payload-processing-e2e-derive-0cd86cdc" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0cd86cdc-7f79688fd5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0cd86cdc-7f79688fd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0cd86cdc: serviceaccount "payload-processing-e2e-derive-0cd86cdc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0cd86cdc-7f79688fd5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-1e9b41-69ddb96749-2nzpn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-0cd86cdc-7f79688fd5-2j56r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-0cd86cdc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-0cd86cdc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c85099b9-ebab-49c4-8867-559b397dd382, UID in object meta:

openshift-ingress

kubelet

e2e-derive-0cd86cdc-openshift-default-6bb787cd5b-nlgvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-1e9b41-openshift-default-65f7b545f8-9lxc2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-c0162b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c0162b

openshift-ingress

replicaset-controller

e2e-explicit-c0162b-openshift-default-6c54d944cb

SuccessfulCreate

Created pod: e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

openshift-ingress

deployment-controller

e2e-explicit-c0162b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c0162b-openshift-default-6c54d944cb from 0 to 1

openshift-ingress

multus

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c0162b-5b9cbddd69

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c0162b-5b9cbddd69

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c0162b-5b9cbddd69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c0162b: serviceaccount "payload-processing-e2e-explicit-c0162b" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c0162b: serviceaccount "payload-processing-e2e-explicit-c0162b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c0162b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c0162b-54dfc875b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c0162b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c0162b-5b9cbddd69 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-0ddeac18-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0ddeac18-openshift-default-688fd8b584 from 0 to 1

openshift-ingress

multus

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-0ddeac18

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-0ddeac18

openshift-ingress

replicaset-controller

e2e-mt-0ddeac18-openshift-default-688fd8b584

SuccessfulCreate

Created pod: e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0ddeac18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0ddeac18-745d6696f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0ddeac18-695b4b86bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0ddeac18-695b4b86bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0ddeac18-695b4b86bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0ddeac18: serviceaccount "payload-processing-e2e-mt-0ddeac18" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0ddeac18: serviceaccount "payload-processing-e2e-mt-0ddeac18" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0ddeac18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0ddeac18-695b4b86bf from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-c0162b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-c0162b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-c0162b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-c0162b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 31945991-516c-4880-af5c-4ad581dbaecd, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-c0162b-openshift-default-6c54d944cb-45kvv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-85f1ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-85f1ab

openshift-ingress

deployment-controller

e2e-noten-85f1ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-85f1ab-openshift-default-5c7864cbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-85f1ab-openshift-default-5c7864cbb

SuccessfulCreate

Created pod: e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c

openshift-ingress

kubelet

e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ddeac18-745d6696f8-2tc89

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-0ddeac18

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-0ddeac18": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-0ddeac18, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 86f0f29b-0645-482f-ab28-e177e6e7a336, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-0ddeac18-openshift-default-688fd8b584-tsfdt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588

SuccessfulCreate

Created pod: e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

openshift-ingress

deployment-controller

e2e-shared-a-w2-ad5be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ad5be0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ad5be0

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-ad5be0

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-ad5be0-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-ad5be0-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ad5be0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ad5be0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0: serviceaccount "payload-processing-e2e-shared-a-w2-ad5be0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ad5be0: serviceaccount "payload-processing-e2e-shared-a-w2-ad5be0" not found

openshift-ingress

kubelet

e2e-noten-85f1ab-openshift-default-5c7864cbb-rqj7c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-408219-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-408219-openshift-default-6f9d8564dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd

SuccessfulCreate

Created pod: e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-408219

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-408219

openshift-ingress

multus

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-408219

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-408219-75667f4fc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-408219-75667f4fc9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-408219-75667f4fc9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-408219-75667f4fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-408219: serviceaccount "payload-processing-e2e-shared-b-w2-408219" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-408219

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-408219: serviceaccount "payload-processing-e2e-shared-b-w2-408219" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1a1e3a-85b988fb98-h8ckt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-1a1e3a-openshift-default-64969f57f8-wtcx7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-bc0b206e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-bc0b206e

openshift-ingress

replicaset-controller

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb

SuccessfulCreate

Created pod: e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

openshift-ingress

deployment-controller

e2e-mt-bc0b206e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-bc0b206e-openshift-default-6b6df9c7cb from 0 to 1

openshift-ingress

multus

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02c60f-758b48cb45-m8d5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02c60f-7864c8846-z2hpw

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-bc0b206e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-bc0b206e-b8dd54f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bc0b206e-b8dd54f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bc0b206e-b8dd54f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-bc0b206e-b8dd54f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bc0b206e: serviceaccount "payload-processing-e2e-mt-bc0b206e" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bc0b206e: serviceaccount "payload-processing-e2e-mt-bc0b206e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-bc0b206e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

Started

Started container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-c97420

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-c97420
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb

SuccessfulCreate

Created pod: e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

openshift-ingress

multus

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-c97420-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-02c60f-openshift-default-848bdbd574-kd74f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c97420-6f4864d77

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-c97420-6f4864d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c97420: serviceaccount "payload-processing-e2e-shared-a-w3-c97420" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c97420: serviceaccount "payload-processing-e2e-shared-a-w3-c97420" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c97420-6f4864d77

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-c97420

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-c97420-6f4864d77 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-c97420

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-c97420-669f46686 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e0c211

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e0c211

openshift-ingress

deployment-controller

e2e-shared-b-w3-e0c211-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6

SuccessfulCreate

Created pod: e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

openshift-ingress

multus

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e0c211

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211: serviceaccount "payload-processing-e2e-shared-b-w3-e0c211" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211: serviceaccount "payload-processing-e2e-shared-b-w3-e0c211" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e0c211

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-bc0b206e-openshift-default-6b6df9c7cb-r5lpl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-api-a-78e0f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-78e0f8-openshift-default-65f487984 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-78e0f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-78e0f8

openshift-ingress

replicaset-controller

e2e-api-a-78e0f8-openshift-default-65f487984

SuccessfulCreate

Created pod: e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

openshift-ingress

multus

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-78e0f8-77d6b9cf47

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6

openshift-ingress

multus

payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-78e0f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-78e0f8-77d6b9cf47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-78e0f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-78e0f8: serviceaccount "payload-processing-e2e-api-a-78e0f8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-78e0f8-77d6b9cf47

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-78e0f8-77d6b9cf47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-78e0f8: serviceaccount "payload-processing-e2e-api-a-78e0f8" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-d2170a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d2170a

openshift-ingress

deployment-controller

e2e-api-b-d2170a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d2170a-openshift-default-6b87b7d64d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-d2170a-openshift-default-6b87b7d64d

SuccessfulCreate

Created pod: e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

openshift-ingress

multus

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d2170a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d2170a-76b659f44b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d2170a-76b659f44b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d2170a-76b659f44b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d2170a: serviceaccount "payload-processing-e2e-api-b-d2170a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d2170a-bcd77649f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d2170a-bcd77649f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d2170a: serviceaccount "payload-processing-e2e-api-b-d2170a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d2170a-76b659f44b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d2170a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d2170a-bcd77649f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d2170a-bcd77649f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4

openshift-ingress

kubelet

payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78e0f8-f4fbc69db-9z9bl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-78e0f8-openshift-default-65f487984-8bqns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-db06d6-594d8dbfd6-cz58q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-db06d6-65cdc768c5-hdvpq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-d2170a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-d2170a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-d2170a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-d2170a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d99edd23-7739-4879-af8c-657a0333182b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d2170a-76b659f44b-2wssn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d2170a-bcd77649f-76pq4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-db06d6-openshift-default-58f5dff6c6-qzcdd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-d2170a-openshift-default-6b87b7d64d-8p5vm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ad5be0-547b4fd45d-c6pvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ad5be0-9b4f485f9-b2r47

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-ad5be0-openshift-default-76b4b5d588-2h997

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-83ba87-86f9b57c-ct8v5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-83ba87-76bff7b578-kdjkr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-408219-58f4db56b6-f6wln

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-408219-75667f4fc9-v4r4x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-83ba87-openshift-default-8f9947d4b-bnknx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-408219-openshift-default-6f9d8564dd-sv4h6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-a-9a6078-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9a6078-openshift-default-6889c7bccb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9a6078

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9a6078

openshift-ingress

multus

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-9a6078-openshift-default-6889c7bccb

SuccessfulCreate

Created pod: e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9a6078

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9a6078-56bdb686b7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9a6078: serviceaccount "payload-processing-e2e-ipp-a-9a6078" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9a6078-56bdb686b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9a6078-56bdb686b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9a6078: serviceaccount "payload-processing-e2e-ipp-a-9a6078" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9a6078-56bdb686b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9a6078

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

Unhealthy

Readiness probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

ProbeError

Readiness probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-213a70

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-213a70-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-213a70-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-213a70

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-213a70

openshift-ingress

deployment-controller

e2e-ipp-b-213a70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-213a70-openshift-default-5d7754d488 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-213a70-openshift-default-5d7754d488

SuccessfulCreate

Created pod: e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

openshift-ingress

multus

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-213a70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-213a70-58455fddcf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-213a70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-213a70-58455fddcf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-213a70: serviceaccount "payload-processing-e2e-ipp-b-213a70" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-213a70-58455fddcf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-213a70-58455fddcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-213a70: serviceaccount "payload-processing-e2e-ipp-b-213a70" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988

SuccessfulCreate

Created pod: e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

openshift-ingress

deployment-controller

e2e-ipp-cleanup-13e3ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-13e3ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-13e3ee

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-13e3ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee: serviceaccount "payload-processing-e2e-ipp-cleanup-13e3ee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-13e3ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee: serviceaccount "payload-processing-e2e-ipp-cleanup-13e3ee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-13e3ee

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-13e3ee": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-13e3ee, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1c935d1b-49e5-4fa9-8b4d-881681c1431f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-13e3ee-5b486c658-m9fgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-13e3ee-openshift-default-7cdb84f988-pdfgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9a6078-5596ffd554-ltwnn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9a6078-openshift-default-6889c7bccb-fkx4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-213a70-58455fddcf-l6b2d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-213a70-54bf7b85c4-cw7dx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-213a70-openshift-default-5d7754d488-dkpsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c97420-669f46686-s2fdr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-c97420-openshift-default-7bfcfc74bb-7znmj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e0c211-openshift-default-94f8c5db6-8nc6g

Killing

Stopping container istio-proxy