Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87 to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98 to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47 to ip-10-0-143-35.ec2.internal

openshift-ingress

payload-processing-e2e-autores-f0271e-8558c55579-6jvbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-f0271e-8558c55579-6jvbf to ip-10-0-133-37.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-p94kg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-p94kg to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6 to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj to ip-10-0-143-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-dab019-cbd64957-fdk2x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dab019-cbd64957-fdk2x to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4 to ip-10-0-143-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4 to ip-10-0-133-37.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-kc7dq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kc7dq to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-g6mbv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-g6mbv to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5 to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk to ip-10-0-133-37.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl to ip-10-0-143-35.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t6lf4 to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc to ip-10-0-143-35.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp

Scheduled

Successfully assigned openshift-ingress/e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp to ip-10-0-143-35.ec2.internal

openshift-ingress

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw to ip-10-0-130-111.ec2.internal

openshift-ingress

kube-auth-proxy-5859ff6677-lllzs

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5859ff6677-lllzs to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv to ip-10-0-130-111.ec2.internal

openshift-ingress

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962 to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj to ip-10-0-143-35.ec2.internal

openshift-ingress

router-default-55766f96d-krtn9

Scheduled

Successfully assigned openshift-ingress/router-default-55766f96d-krtn9 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk to ip-10-0-130-111.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5 to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn to ip-10-0-143-35.ec2.internal

openshift-ingress

payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

Scheduled

Successfully assigned openshift-ingress/e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp to ip-10-0-133-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7 to ip-10-0-133-37.ec2.internal

openshift-ingress

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

Scheduled

Successfully assigned openshift-ingress/e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r to ip-10-0-143-35.ec2.internal

openshift-ingress

kube-auth-proxy-5859ff6677-dkk9d

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5859ff6677-dkk9d to ip-10-0-143-35.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-72hb9

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-72hb9 to ip-10-0-143-35.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-55766f96d from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-55766f96d

FailedCreate

Error creating: pods "router-default-55766f96d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-55766f96d

FailedCreate

Error creating: pods "router-default-55766f96d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-55766f96d

SuccessfulCreate

Created pod: router-default-55766f96d-krtn9
(x6)

openshift-ingress

kubelet

router-default-55766f96d-krtn9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-55766f96d-krtn9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-55766f96d-krtn9

Started

Started container router

openshift-ingress

multus

router-default-55766f96d-krtn9

AddedInterface

Add eth0 [10.133.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-55766f96d-krtn9

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-55766f96d-krtn9

Created

Created container: router
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-5859ff6677

FailedCreate

Error creating: pods "kube-auth-proxy-5859ff6677-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5859ff6677

SuccessfulCreate

Created pod: kube-auth-proxy-5859ff6677-dkk9d

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5859ff6677 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-dkk9d

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-lllzs

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5859ff6677

SuccessfulCreate

Created pod: kube-auth-proxy-5859ff6677-lllzs

openshift-ingress

multus

kube-auth-proxy-5859ff6677-dkk9d

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-dkk9d

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5859ff6677-lllzs

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-kc7dq

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-kc7dq

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kc7dq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-lllzs

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kc7dq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.193s (3.193s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-lllzs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.563s (2.563s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-dkk9d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.026s (4.026s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-lllzs

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-lllzs

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kc7dq

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-dkk9d

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5859ff6677-dkk9d

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kc7dq

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.651s (2.651s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6fpjd

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-p94kg

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-p94kg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-p94kg

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-p94kg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.579s (2.579s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-p94kg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-p94kg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-p94kg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-p94kg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kc7dq

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-kc7dq

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-t6lf4

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.793s (2.793s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-72hb9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-g6mbv
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-g6mbv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-g6mbv

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-72hb9

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-72hb9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-g6mbv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-72hb9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-72hb9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-72hb9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.586s (2.586s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-g6mbv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-g6mbv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.54s (2.54s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t6lf4

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ff0f3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ff0f3e

openshift-ingress

multus

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-ff0f3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ff0f3e-openshift-default-7cd7457974 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-ff0f3e-openshift-default-7cd7457974

SuccessfulCreate

Created pod: e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ff0f3e-5f56dc657

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ff0f3e-5f56dc657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ff0f3e: serviceaccount "payload-processing-e2e-inf-a-ff0f3e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ff0f3e-5f56dc657

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ff0f3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ff0f3e-5f56dc657 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ff0f3e: serviceaccount "payload-processing-e2e-inf-a-ff0f3e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ff0f3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.72s (1.72s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.73s (1.73s including waiting). Image size: 166449337 bytes.

openshift-ingress

deployment-controller

e2e-ait-8d710ebd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8d710ebd-openshift-default-7664fc86f8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8d710ebd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8d710ebd

openshift-ingress

replicaset-controller

e2e-ait-8d710ebd-openshift-default-7664fc86f8

SuccessfulCreate

Created pod: e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

openshift-ingress

multus

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-f0271e-openshift-default-598dd6b97b

SuccessfulCreate

Created pod: e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

openshift-ingress

deployment-controller

e2e-autores-f0271e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-f0271e-openshift-default-598dd6b97b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-f0271e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-f0271e

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8d710ebd-7cb876d44f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8d710ebd-7cb876d44f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8d710ebd: serviceaccount "payload-processing-e2e-ait-8d710ebd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8d710ebd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8d710ebd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8d710ebd-7cb876d44f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8d710ebd: serviceaccount "payload-processing-e2e-ait-8d710ebd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8d710ebd-7cb876d44f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

openshift-ingress

multus

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f0271e-8558c55579

SuccessfulCreate

Created pod: payload-processing-e2e-autores-f0271e-8558c55579-6jvbf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f0271e-5785695f4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-f0271e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-f0271e-5785695f4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-f0271e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-f0271e-8558c55579 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f0271e-5785695f4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-f0271e-5785695f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f0271e: serviceaccount "payload-processing-e2e-autores-f0271e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f0271e-8558c55579

FailedCreate

Error creating: pods "payload-processing-e2e-autores-f0271e-8558c55579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f0271e: serviceaccount "payload-processing-e2e-autores-f0271e" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-f0271e-8558c55579-6jvbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-f0271e-8558c55579-6jvbf

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.343s (2.343s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.296s (2.296s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-f0271e-8558c55579-6jvbf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-f0271e-8558c55579-6jvbf

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": read tcp 10.134.0.2:43992->10.134.0.51:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": read tcp 10.134.0.2:43992->10.134.0.51:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4

SuccessfulCreate

Created pod: e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

openshift-ingress

gateway_labeler_controller

e2e-inf-b-cf5ae2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-cf5ae2

openshift-ingress

deployment-controller

e2e-inf-b-cf5ae2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4 from 0 to 1

openshift-ingress

multus

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cf5ae2: serviceaccount "payload-processing-e2e-inf-b-cf5ae2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-cf5ae2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-cf5ae2-575494c466 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-cf5ae2: serviceaccount "payload-processing-e2e-inf-b-cf5ae2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-cf5ae2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:48908->10.134.0.53:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:48908->10.134.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-8d710ebd-7cb876d44f-vkpgk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8d710ebd-54d8554bdb-lk5sx

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-8d710ebd-openshift-default-7664fc86f8-xb88x

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-4cc32bbe-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4cc32bbe-gw

openshift-ingress

deployment-controller

e2e-migrate-4cc32bbe-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8

SuccessfulCreate

Created pod: e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

openshift-ingress

multus

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4cc32bbe: serviceaccount "payload-processing-e2e-migrate-4cc32bbe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4cc32bbe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4cc32bbe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4cc32bbe: serviceaccount "payload-processing-e2e-migrate-4cc32bbe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4cc32bbe-987985c4b-45cgn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4cc32bbe-848d7bdc5d-jw4d7

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-4001bd59

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4001bd59

openshift-ingress

kubelet

e2e-migrate-4cc32bbe-gw-openshift-default-87bd845b8-kt7s4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-4001bd59-openshift-default-6bf4c87858

SuccessfulCreate

Created pod: e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

openshift-ingress

deployment-controller

e2e-ait-4001bd59-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4001bd59-openshift-default-6bf4c87858 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4001bd59

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4001bd59-6b95f9865c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4001bd59-6b95f9865c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4001bd59-6b95f9865c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4001bd59: serviceaccount "payload-processing-e2e-ait-4001bd59" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4001bd59

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4001bd59-9cb576846 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4001bd59-9cb576846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4001bd59-9cb576846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4001bd59-9cb576846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4001bd59: serviceaccount "payload-processing-e2e-ait-4001bd59" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4001bd59-6b95f9865c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x

openshift-ingress

multus

payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": read tcp 10.134.0.2:54516->10.134.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": read tcp 10.134.0.2:54516->10.134.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4001bd59-9cb576846-lm5dw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-4001bd59

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-4001bd59: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-4001bd59": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-4001bd59, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 241da3a1-125b-4aea-8196-d2ac9c1af5e7, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-4001bd59-6b95f9865c-j962x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-efa641f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-efa641f8

openshift-ingress

multus

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-efa641f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-efa641f8-openshift-default-dd54f9dd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-efa641f8-openshift-default-dd54f9dd4

SuccessfulCreate

Created pod: e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

openshift-ingress

deployment-controller

payload-processing-e2e-derive-efa641f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-efa641f8-656c7554c7 from 0 to 1

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-4001bd59-openshift-default-6bf4c87858-8qr47

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-efa641f8-656c7554c7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-efa641f8-656c7554c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-efa641f8: serviceaccount "payload-processing-e2e-derive-efa641f8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-efa641f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-efa641f8: serviceaccount "payload-processing-e2e-derive-efa641f8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-efa641f8-656c7554c7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x

openshift-ingress

multus

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:36516->10.134.0.58:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:36516->10.134.0.58:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-efa641f8-656c7554c7-ngj4x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-efa641f8-695fcf5ff8-lnxb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-efa641f8-openshift-default-dd54f9dd4-w4n2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-f0271e-8558c55579-6jvbf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f0271e-5785695f4b-rw7d4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-f0271e-openshift-default-598dd6b97b-2qjdp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-cb3759-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-cb3759-openshift-default-5b6f7b5976 from 0 to 1

openshift-ingress

multus

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-cb3759-openshift-default-5b6f7b5976

SuccessfulCreate

Created pod: e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

openshift-ingress

gateway_labeler_controller

e2e-explicit-cb3759

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-cb3759
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cb3759-59f8bd5b65

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-cb3759-59f8bd5b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cb3759: serviceaccount "payload-processing-e2e-explicit-cb3759" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-cb3759

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-cb3759-59f8bd5b65 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cb3759-5c88648594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-cb3759-5c88648594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cb3759: serviceaccount "payload-processing-e2e-explicit-cb3759" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-cb3759

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-cb3759-5c88648594 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cb3759-5c88648594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts

openshift-ingress

multus

payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cb3759-59f8bd5b65

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq

openshift-ingress

kubelet

payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-7c5e63de-openshift-default-777b9846dd

SuccessfulCreate

Created pod: e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

openshift-ingress

deployment-controller

e2e-mt-7c5e63de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7c5e63de-openshift-default-777b9846dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-7c5e63de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7c5e63de

openshift-ingress

multus

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cb3759-5c88648594-mjwts

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cb3759-59f8bd5b65-jphmq

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7c5e63de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7c5e63de-d4769df7d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7c5e63de: serviceaccount "payload-processing-e2e-mt-7c5e63de" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7c5e63de-656f8b5665

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7c5e63de-656f8b5665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7c5e63de: serviceaccount "payload-processing-e2e-mt-7c5e63de" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7c5e63de-656f8b5665

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7c5e63de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7c5e63de-656f8b5665 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-explicit-cb3759-openshift-default-5b6f7b5976-tn962

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-cbda8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-cbda8a

openshift-ingress

deployment-controller

e2e-noten-cbda8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-cbda8a-openshift-default-84cf77469d from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-cbda8a-openshift-default-84cf77469d

SuccessfulCreate

Created pod: e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp

openshift-ingress

kubelet

e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-cbda8a-openshift-default-84cf77469d-nhfhp

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-7c5e63de-656f8b5665-wgmdc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c5e63de-d4769df7d-98g7j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ff0f3e-5f56dc657-sshf7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ff0f3e-59d579689d-6t54c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ff0f3e-openshift-default-7cd7457974-c9j75

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7c5e63de-openshift-default-777b9846dd-lmg4g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-cf5ae2-cb4b5f54c-bxhlw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-cf5ae2-575494c466-bn24h

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-a-w2-75264d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-75264d-openshift-default-56d5f54b78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78

SuccessfulCreate

Created pod: e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-75264d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-75264d

openshift-ingress

multus

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-75264d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-75264d-6dff9b45 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-75264d-6dff9b45

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-75264d-6dff9b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-75264d: serviceaccount "payload-processing-e2e-shared-a-w2-75264d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-75264d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-75264d: serviceaccount "payload-processing-e2e-shared-a-w2-75264d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-75264d-6dff9b45

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-cf5ae2-openshift-default-6776bbbdb4-8jqds

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d

SuccessfulCreate

Created pod: e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w3-c2a8bb

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w3-c2a8bb-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w3-c2a8bb-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-shared-a-w3-c2a8bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-c2a8bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-c2a8bb

openshift-ingress

multus

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-c2a8bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c2a8bb: serviceaccount "payload-processing-e2e-shared-a-w3-c2a8bb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-c2a8bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c2a8bb: serviceaccount "payload-processing-e2e-shared-a-w3-c2a8bb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": read tcp 10.133.0.2:51586->10.133.0.73:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": read tcp 10.133.0.2:51586->10.133.0.73:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-c2eafd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-c2eafd

openshift-ingress

deployment-controller

e2e-shared-b-w2-c2eafd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-c2eafd-openshift-default-55586775d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6

SuccessfulCreate

Created pod: e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

openshift-ingress

multus

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c2eafd: serviceaccount "payload-processing-e2e-shared-b-w2-c2eafd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-c2eafd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-c2eafd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c2eafd: serviceaccount "payload-processing-e2e-shared-b-w2-c2eafd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-b-w3-720789-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-720789-openshift-default-664d4b5fd8 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8

SuccessfulCreate

Created pod: e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-720789

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-720789
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-720789: serviceaccount "payload-processing-e2e-shared-b-w3-720789" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-720789

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-720789-5759f8c6c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-720789: serviceaccount "payload-processing-e2e-shared-b-w3-720789" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-720789

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486 from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": read tcp 10.134.0.2:49610->10.134.0.65:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": read tcp 10.134.0.2:49610->10.134.0.65:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-777fbd7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-777fbd7c

openshift-ingress

GatewayAuthBootstrap

e2e-mt-777fbd7c

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-777fbd7c-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-777fbd7c-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-mt-777fbd7c-openshift-default-55b945cbb8

SuccessfulCreate

Created pod: e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

openshift-ingress

deployment-controller

e2e-mt-777fbd7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-777fbd7c-openshift-default-55b945cbb8 from 0 to 1

openshift-ingress

multus

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-777fbd7c-56445b5f77

SuccessfulCreate

Created pod: payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-777fbd7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-777fbd7c-86676597cd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-777fbd7c-86676597cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-777fbd7c-56445b5f77

FailedCreate

Error creating: pods "payload-processing-e2e-mt-777fbd7c-56445b5f77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-777fbd7c: serviceaccount "payload-processing-e2e-mt-777fbd7c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-777fbd7c-86676597cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-777fbd7c-86676597cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-777fbd7c: serviceaccount "payload-processing-e2e-mt-777fbd7c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-777fbd7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-777fbd7c-56445b5f77 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-777fbd7c-86676597cd-7xsb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-777fbd7c-56445b5f77-h6bpv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-777fbd7c-openshift-default-55b945cbb8-dn8l5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-dab019-openshift-default-6b54f55bb

SuccessfulCreate

Created pod: e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

openshift-ingress

gateway_labeler_controller

e2e-api-a-dab019

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dab019

openshift-ingress

deployment-controller

e2e-api-a-dab019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-dab019-openshift-default-6b54f55bb from 0 to 1

openshift-ingress

multus

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dab019-cbd64957

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-dab019-cbd64957-fdk2x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-dab019

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-dab019-7d88b56774 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dab019-cbd64957

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-dab019-cbd64957-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dab019: serviceaccount "payload-processing-e2e-api-a-dab019" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dab019-7d88b56774

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-dab019-7d88b56774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dab019: serviceaccount "payload-processing-e2e-api-a-dab019" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dab019-7d88b56774

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-dab019

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-dab019-cbd64957 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-dab019-cbd64957-fdk2x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-dab019-cbd64957-fdk2x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-dab019-cbd64957-fdk2x

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-dab019-cbd64957-fdk2x

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-7bac07-openshift-default-8d5d7f598

SuccessfulCreate

Created pod: e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

openshift-ingress

gateway_labeler_controller

e2e-api-b-7bac07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7bac07

openshift-ingress

deployment-controller

e2e-api-b-7bac07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7bac07-openshift-default-8d5d7f598 from 0 to 1

openshift-ingress

multus

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7bac07-659df5cddf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7bac07-659df5cddf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7bac07: serviceaccount "payload-processing-e2e-api-b-7bac07" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7bac07: serviceaccount "payload-processing-e2e-api-b-7bac07" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7bac07-659df5cddf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7bac07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7bac07-659df5cddf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7bac07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7bac07-6dbc58c494 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dab019-7d88b56774-xklfw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dab019-cbd64957-fdk2x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-dab019-openshift-default-6b54f55bb-hr4fc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7bac07-6dbc58c494-p5hsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7bac07-659df5cddf-nl27s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-7bac07-openshift-default-8d5d7f598-jpwsj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-75264d-6dff9b45-rhzbw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-75264d-b5468674b-62dwz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-75264d-openshift-default-56d5f54b78-s7fnf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c2eafd-cb94c98d9-55w6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c2eafd-5f7655f74b-ljj2m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-c2eafd-openshift-default-55586775d6-2cssj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-520856-openshift-default-6557c5d99d

SuccessfulCreate

Created pod: e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-520856

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-520856

openshift-ingress

deployment-controller

e2e-ipp-a-520856-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-520856-openshift-default-6557c5d99d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-520856: serviceaccount "payload-processing-e2e-ipp-a-520856" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-520856

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-520856-7dc4f47677

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-520856-7dc4f47677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-520856: serviceaccount "payload-processing-e2e-ipp-a-520856" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-520856-7dc4f47677

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-520856

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-520856-7dc4f47677 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6c84ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6c84ae

openshift-ingress

deployment-controller

e2e-ipp-b-6c84ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6c84ae-openshift-default-7b65c76854 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-6c84ae-openshift-default-7b65c76854

SuccessfulCreate

Created pod: e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

openshift-ingress

multus

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6c84ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6c84ae: serviceaccount "payload-processing-e2e-ipp-b-6c84ae" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6c84ae: serviceaccount "payload-processing-e2e-ipp-b-6c84ae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6c84ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

ProbeError

Readiness probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

Unhealthy

Readiness probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-431421

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-431421

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

openshift-ingress

multus

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-431421-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-431421-openshift-default-689fccb8bb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-431421-68c5b44989

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-431421-68c5b44989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-431421: serviceaccount "payload-processing-e2e-ipp-cleanup-431421" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-431421

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-431421-68c5b44989

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-431421: serviceaccount "payload-processing-e2e-ipp-cleanup-431421" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-431421

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-431421-68c5b44989 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-431421-68c5b44989-dfq98

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-431421-658c9c8498-54wr8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-431421-openshift-default-689fccb8bb-lpnzn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-520856-7dc4f47677-nh8h6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-520856-5cbf8fd7fd-7x77v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-520856-openshift-default-6557c5d99d-g4nqk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6c84ae-6b9bffbfc4-zmcpv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6c84ae-cd44c5dc7-srkhz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-6c84ae-openshift-default-7b65c76854-c9xtg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2a8bb-5955b98cbc-rw4x8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2a8bb-f54b96578-mlv87

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-c2a8bb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c2a8bb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-c2a8bb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c2a8bb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6bc286f8-30b3-42c6-8779-4d6755238613, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-c2a8bb-openshift-default-b5fc6b6d-95hvt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-720789-5759f8c6c9-27djh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-720789-55f75d4486-z8dp7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-720789

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-720789: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-720789": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-720789, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 54ca5b8b-70bd-4509-95d8-81589e44bdba, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-720789-openshift-default-664d4b5fd8-lk5cl

Killing

Stopping container istio-proxy