Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z to ip-10-0-141-215.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-lvldr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Scheduled

Successfully assigned openshift-ingress/e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9 to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp to ip-10-0-133-222.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vtckc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vtckc to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685 to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r to ip-10-0-133-222.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7 to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

Scheduled

Successfully assigned openshift-ingress/e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-x5r9q

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-x5r9q to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-4gbbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49 to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

Scheduled

Successfully assigned openshift-ingress/e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762 to ip-10-0-133-222.ec2.internal

openshift-ingress

kube-auth-proxy-65f4688f79-d4v4q

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65f4688f79-d4v4q to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b54c32-f695d495-vtwg5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b54c32-f695d495-vtwg5 to ip-10-0-133-222.ec2.internal

openshift-ingress

router-default-5cd8bf6458-jhsss

Scheduled

Successfully assigned openshift-ingress/router-default-5cd8bf6458-jhsss to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-autores-61e623-54fc96f859-lxvv4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-61e623-54fc96f859-lxvv4 to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4 to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv to ip-10-0-133-222.ec2.internal

openshift-ingress

kube-auth-proxy-65f4688f79-k7p9x

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65f4688f79-k7p9x to ip-10-0-140-44.ec2.internal

openshift-ingress

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

Scheduled

Successfully assigned openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7 to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc to ip-10-0-133-222.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-dxbq6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg to ip-10-0-141-215.ec2.internal

openshift-ingress

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g to ip-10-0-133-222.ec2.internal

openshift-ingress

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

Scheduled

Successfully assigned openshift-ingress/e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m to ip-10-0-133-222.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484 to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc to ip-10-0-141-215.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs to ip-10-0-141-215.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5cd8bf6458 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-5cd8bf6458

FailedCreate

Error creating: pods "router-default-5cd8bf6458-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-5cd8bf6458

FailedCreate

Error creating: pods "router-default-5cd8bf6458-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5cd8bf6458

SuccessfulCreate

Created pod: router-default-5cd8bf6458-jhsss
(x6)

openshift-ingress

kubelet

router-default-5cd8bf6458-jhsss

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5cd8bf6458-jhsss

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5cd8bf6458-jhsss

Created

Created container: router

openshift-ingress

kubelet

router-default-5cd8bf6458-jhsss

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-5cd8bf6458-jhsss

Started

Started container router

openshift-ingress

multus

router-default-5cd8bf6458-jhsss

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-65f4688f79 from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-65f4688f79

FailedCreate

Error creating: pods "kube-auth-proxy-65f4688f79-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-65f4688f79

SuccessfulCreate

Created pod: kube-auth-proxy-65f4688f79-d4v4q

openshift-ingress

replicaset-controller

kube-auth-proxy-65f4688f79

SuccessfulCreate

Created pod: kube-auth-proxy-65f4688f79-k7p9x

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-d4v4q

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-65f4688f79-k7p9x

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-k7p9x

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-65f4688f79-d4v4q

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vtckc

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtckc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vtckc

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-d4v4q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.448s (2.448s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-d4v4q

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-d4v4q

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-k7p9x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.072s (3.072s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-k7p9x

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65f4688f79-k7p9x

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtckc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.097s (2.097s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtckc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtckc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtckc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtckc

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-qmcch" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cfh66k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.58s (2.58s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-lvldr

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lvldr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-lvldr

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lvldr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.308s (2.308s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lvldr

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lvldr

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtckc

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vtckc

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-dxbq6

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-dxbq6

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-x5r9q

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4gbbx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x5r9q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-4gbbx

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-x5r9q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-4gbbx

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4gbbx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4gbbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4gbbx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.264s (1.264s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x5r9q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x5r9q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.362s (2.362s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x5r9q

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-dxbq6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-dxbq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-dxbq6

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-dxbq6

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-dxbq6

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-48d98f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-48d98f

openshift-ingress

deployment-controller

e2e-inf-a-48d98f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-825f30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-825f30-openshift-default-85558f6fd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-825f30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-825f30

openshift-ingress

multus

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d

SuccessfulCreate

Created pod: e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-736809

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-736809

openshift-ingress

deployment-controller

e2e-worker-w0-736809-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-736809-openshift-default-58bd7799bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-736809-openshift-default-58bd7799bb

SuccessfulCreate

Created pod: e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

openshift-ingress

replicaset-controller

e2e-worker-w4-825f30-openshift-default-85558f6fd8

SuccessfulCreate

Created pod: e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

openshift-ingress

multus

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-825f30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-825f30-85d7bd455 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-825f30: serviceaccount "payload-processing-e2e-worker-w4-825f30" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-825f30-85d7bd455

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-825f30-85d7bd455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-825f30: serviceaccount "payload-processing-e2e-worker-w4-825f30" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-825f30-85d7bd455

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-825f30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk

openshift-ingress

multus

payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48d98f: serviceaccount "payload-processing-e2e-inf-a-48d98f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-48d98f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-48d98f-6bcb4f8579

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-48d98f-6bcb4f8579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48d98f: serviceaccount "payload-processing-e2e-inf-a-48d98f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-48d98f-6bcb4f8579

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-48d98f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-48d98f-6bcb4f8579 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-736809

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-736809-68ddd69c57

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-736809-68ddd69c57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-736809: serviceaccount "payload-processing-e2e-worker-w0-736809" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-736809: serviceaccount "payload-processing-e2e-worker-w0-736809" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-736809-68ddd69c57

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs

openshift-ingress

multus

payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-736809

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-736809-68ddd69c57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-54be2504

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-54be2504

openshift-ingress

replicaset-controller

e2e-ait-54be2504-openshift-default-6b896c678b

SuccessfulCreate

Created pod: e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

openshift-ingress

deployment-controller

e2e-ait-54be2504-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-54be2504-openshift-default-6b896c678b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-61e623

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-61e623

openshift-ingress

multus

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-61e623-openshift-default-5c49548b8d

SuccessfulCreate

Created pod: e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

openshift-ingress

deployment-controller

e2e-autores-61e623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-61e623-openshift-default-5c49548b8d from 0 to 1

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.53s (2.53s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-61e623-54fc96f859

SuccessfulCreate

Created pod: payload-processing-e2e-autores-61e623-54fc96f859-lxvv4

openshift-ingress

deployment-controller

payload-processing-e2e-autores-61e623

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-61e623-54fc96f859 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-61e623

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-61e623-7d5b4749fd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-61e623-54fc96f859

FailedCreate

Error creating: pods "payload-processing-e2e-autores-61e623-54fc96f859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-61e623: serviceaccount "payload-processing-e2e-autores-61e623" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-61e623-7d5b4749fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-61e623-7d5b4749fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-61e623: serviceaccount "payload-processing-e2e-autores-61e623" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-61e623-7d5b4749fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl

openshift-ingress

kubelet

payload-processing-e2e-autores-61e623-54fc96f859-lxvv4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-61e623-54fc96f859-lxvv4

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-61e623-54fc96f859-lxvv4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-61e623-54fc96f859-lxvv4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-54be2504-5bd7cc4c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-54be2504

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-54be2504-7979c6d9d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54be2504: serviceaccount "payload-processing-e2e-ait-54be2504" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-54be2504-5bd7cc4c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-54be2504-5bd7cc4c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54be2504: serviceaccount "payload-processing-e2e-ait-54be2504" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-54be2504

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-54be2504-5bd7cc4c7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-inf-b-f38e68-openshift-default-9dff74fb8

SuccessfulCreate

Created pod: e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f38e68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f38e68

openshift-ingress

deployment-controller

e2e-inf-b-f38e68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f38e68-openshift-default-9dff74fb8 from 0 to 1

openshift-ingress

multus

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f38e68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f38e68-5d4f46496c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f38e68: serviceaccount "payload-processing-e2e-inf-b-f38e68" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f38e68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f38e68-5df67f69db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f38e68-5d4f46496c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f38e68-5d4f46496c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f38e68: serviceaccount "payload-processing-e2e-inf-b-f38e68" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f38e68-5d4f46496c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:45764->10.132.0.48:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:45764->10.132.0.48:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-54be2504

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-54be2504: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-54be2504": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-54be2504, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f738c83e-aaf7-4539-8fa3-1bdc2fb23dfe, UID in object meta:

openshift-ingress

replicaset-controller

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48

SuccessfulCreate

Created pod: e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

openshift-ingress

deployment-controller

e2e-migrate-eb3352f3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-eb3352f3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-eb3352f3-gw

openshift-ingress

multus

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eb3352f3: serviceaccount "payload-processing-e2e-migrate-eb3352f3" not found
(x6)

openshift-ingress

kubelet

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eb3352f3: serviceaccount "payload-processing-e2e-migrate-eb3352f3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-eb3352f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-eb3352f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-eb3352f3-5fc8458b6b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc
(x6)

openshift-ingress

kubelet

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-5ab8e6b6-openshift-default-cfbb585d

SuccessfulCreate

Created pod: e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

openshift-ingress

deployment-controller

e2e-ait-5ab8e6b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5ab8e6b6-openshift-default-cfbb585d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-5ab8e6b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5ab8e6b6

openshift-ingress

multus

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5ab8e6b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5ab8e6b6: serviceaccount "payload-processing-e2e-ait-5ab8e6b6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5ab8e6b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5ab8e6b6: serviceaccount "payload-processing-e2e-ait-5ab8e6b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg

openshift-ingress

kubelet

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr

openshift-ingress

kubelet

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-46ccf8cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-46ccf8cf

openshift-ingress

multus

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-46ccf8cf-openshift-default-6859757964

SuccessfulCreate

Created pod: e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

openshift-ingress

deployment-controller

e2e-derive-46ccf8cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-46ccf8cf-openshift-default-6859757964 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-46ccf8cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-46ccf8cf-94944b954 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-46ccf8cf-94944b954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-46ccf8cf-94944b954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-46ccf8cf-94944b954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46ccf8cf: serviceaccount "payload-processing-e2e-derive-46ccf8cf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-46ccf8cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-46ccf8cf-75bd986b65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-46ccf8cf-75bd986b65

SuccessfulCreate

Created pod: payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-46ccf8cf-75bd986b65

FailedCreate

Error creating: pods "payload-processing-e2e-derive-46ccf8cf-75bd986b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46ccf8cf: serviceaccount "payload-processing-e2e-derive-46ccf8cf" not found
(x2)

openshift-ingress

kubelet

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-61e623

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-61e623: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-61e623": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-61e623, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9ec9efe3-6512-470f-aac2-34800dae30b4, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-61e623-54fc96f859-lxvv4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-35df6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-35df6d

openshift-ingress

kubelet

e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-35df6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-35df6d-openshift-default-6cccb6d8dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-35df6d-openshift-default-6cccb6d8dd

SuccessfulCreate

Created pod: e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

openshift-ingress

multus

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-35df6d-66f95dfccc

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-35df6d-66f95dfccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-35df6d: serviceaccount "payload-processing-e2e-explicit-35df6d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-35df6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-35df6d-66f95dfccc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-35df6d-c96747fc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-35df6d-c96747fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-35df6d: serviceaccount "payload-processing-e2e-explicit-35df6d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-35df6d-c96747fc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-35df6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-35df6d-c96747fc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-35df6d-66f95dfccc

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4

openshift-ingress

multus

payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-mt-85682bb8

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-85682bb8-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-85682bb8-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-mt-85682bb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-85682bb8

openshift-ingress

deployment-controller

e2e-mt-85682bb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-85682bb8-openshift-default-9677fcd68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-85682bb8-openshift-default-9677fcd68

SuccessfulCreate

Created pod: e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

openshift-ingress

multus

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-85682bb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-85682bb8-6bd9558b45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-85682bb8-6bd9558b45

SuccessfulCreate

Created pod: payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-85682bb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-85682bb8-6bd9558b45

FailedCreate

Error creating: pods "payload-processing-e2e-mt-85682bb8-6bd9558b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85682bb8: serviceaccount "payload-processing-e2e-mt-85682bb8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85682bb8: serviceaccount "payload-processing-e2e-mt-85682bb8" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-b52922

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b52922

openshift-ingress

multus

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-b52922-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b52922-openshift-default-76f7cc4666 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666

SuccessfulCreate

Created pod: e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b52922: serviceaccount "payload-processing-e2e-shared-a-w2-b52922" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b52922: serviceaccount "payload-processing-e2e-shared-a-w2-b52922" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-b52922

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-b52922

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-noten-be3eb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-be3eb4-openshift-default-684dc4b59d from 0 to 1

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-noten-be3eb4-openshift-default-684dc4b59d

SuccessfulCreate

Created pod: e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

openshift-ingress

kubelet

e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-be3eb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-be3eb4

openshift-ingress

kubelet

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-efffde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-efffde

openshift-ingress

deployment-controller

e2e-shared-b-w2-efffde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-efffde-openshift-default-7bf694c556 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-efffde-openshift-default-7bf694c556

SuccessfulCreate

Created pod: e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

openshift-ingress

multus

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-efffde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-efffde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-efffde: serviceaccount "payload-processing-e2e-shared-b-w2-efffde" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-efffde: serviceaccount "payload-processing-e2e-shared-b-w2-efffde" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-09450b8d-openshift-default-8579ff9cd4

SuccessfulCreate

Created pod: e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

openshift-ingress

gateway_labeler_controller

e2e-mt-09450b8d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-09450b8d

openshift-ingress

deployment-controller

e2e-mt-09450b8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-09450b8d-openshift-default-8579ff9cd4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-09450b8d: serviceaccount "payload-processing-e2e-mt-09450b8d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-09450b8d-58d8f68cb9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-09450b8d-58d8f68cb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-09450b8d: serviceaccount "payload-processing-e2e-mt-09450b8d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-09450b8d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-09450b8d-58d8f68cb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-09450b8d-58d8f68cb9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-09450b8d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-f80c49-openshift-default-5887749d84

SuccessfulCreate

Created pod: e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

openshift-ingress

deployment-controller

e2e-shared-a-w3-f80c49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-f80c49-openshift-default-5887749d84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-f80c49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-f80c49

openshift-ingress

multus

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-f80c49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49: serviceaccount "payload-processing-e2e-shared-a-w3-f80c49" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49: serviceaccount "payload-processing-e2e-shared-a-w3-f80c49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-f80c49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b

SuccessfulCreate

Created pod: e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

openshift-ingress

deployment-controller

e2e-shared-b-w3-f6ac6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-f6ac6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f6ac6e
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-f6ac6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e: serviceaccount "payload-processing-e2e-shared-b-w3-f6ac6e" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-f6ac6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e: serviceaccount "payload-processing-e2e-shared-b-w3-f6ac6e" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-09450b8d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-09450b8d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-09450b8d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-09450b8d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2e8ed832-93c0-42cb-8b42-01c56dad4dba, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-9148ad-openshift-default-7c7df558c8

SuccessfulCreate

Created pod: e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

openshift-ingress

deployment-controller

e2e-api-a-9148ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9148ad-openshift-default-7c7df558c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-9148ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9148ad

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9148ad-74c7fb57df

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9148ad-74c7fb57df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9148ad: serviceaccount "payload-processing-e2e-api-a-9148ad" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9148ad-85565d666b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9148ad-85565d666b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9148ad: serviceaccount "payload-processing-e2e-api-a-9148ad" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9148ad-85565d666b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9148ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9148ad-85565d666b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9148ad-74c7fb57df

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw

openshift-ingress

multus

payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9148ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9148ad-74c7fb57df from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-b54c32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b54c32

openshift-ingress

deployment-controller

e2e-api-b-b54c32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b54c32-openshift-default-5f7c977d84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-b54c32-openshift-default-5f7c977d84

SuccessfulCreate

Created pod: e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

openshift-ingress

multus

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b54c32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b54c32-b689c786 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b54c32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b54c32-f695d495 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-b54c32-f695d495-vtwg5

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b54c32-f695d495

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b54c32-f695d495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b54c32: serviceaccount "payload-processing-e2e-api-b-b54c32" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b54c32-f695d495

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b54c32-f695d495-vtwg5

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b54c32-b689c786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88

openshift-ingress

kubelet

payload-processing-e2e-api-b-b54c32-f695d495-vtwg5

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b54c32-b689c786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b54c32-b689c786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b54c32: serviceaccount "payload-processing-e2e-api-b-b54c32" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-b54c32-f695d495-vtwg5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-b54c32-f695d495-vtwg5

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b54c32-f695d495-vtwg5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-b52922

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-b52922": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8e6e4899-182e-43a4-b574-389fe7290e3f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-736809

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-736809: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-736809": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-736809, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8eb4bd5c-99e8-4cd2-b7fb-7d5295e28848, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-36fb5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-36fb5c-openshift-default-5cf8c45564 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-36fb5c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-36fb5c

openshift-ingress

replicaset-controller

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564

SuccessfulCreate

Created pod: e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-36fb5c: serviceaccount "payload-processing-e2e-ipp-a-36fb5c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-36fb5c-86ffd6687

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-36fb5c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-36fb5c-86ffd6687

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-36fb5c-86ffd6687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-36fb5c: serviceaccount "payload-processing-e2e-ipp-a-36fb5c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-36fb5c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-36fb5c-86ffd6687 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-3c1ddb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3c1ddb

openshift-ingress

multus

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6

SuccessfulCreate

Created pod: e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

openshift-ingress

deployment-controller

e2e-ipp-b-3c1ddb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb: serviceaccount "payload-processing-e2e-ipp-b-3c1ddb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3c1ddb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3c1ddb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb: serviceaccount "payload-processing-e2e-ipp-b-3c1ddb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

Unhealthy

Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

ProbeError

Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-26b61a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-26b61a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-26b61a

openshift-ingress

multus

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-26b61a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-26b61a-b588c6499 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a: serviceaccount "payload-processing-e2e-ipp-cleanup-26b61a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a: serviceaccount "payload-processing-e2e-ipp-cleanup-26b61a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-26b61a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-26b61a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-26b61a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fdc851b4-bb64-4d97-9a36-da6efb00c463, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503