Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9 to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8 to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d to ip-10-0-132-9.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j to ip-10-0-139-23.ec2.internal

openshift-ingress

payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98 to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl to ip-10-0-139-23.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-9zkpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-9zkpq to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt to ip-10-0-132-9.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-wptls

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf

Scheduled

Successfully assigned openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5 to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9 to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz to ip-10-0-129-205.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-zbwms

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4e1907f7-678787588f-6pl87

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87 to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq to ip-10-0-129-205.ec2.internal

openshift-ingress

kube-auth-proxy-7b66dcfb4c-2t28m

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd to ip-10-0-129-205.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c47gnt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c47gnt to ip-10-0-139-23.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29 to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv to ip-10-0-139-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845 to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-zwf8d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt to ip-10-0-132-9.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-tszg8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-tszg8 to ip-10-0-139-23.ec2.internal

openshift-ingress

router-default-858dfcf476-rkhcs

Scheduled

Successfully assigned openshift-ingress/router-default-858dfcf476-rkhcs to ip-10-0-139-23.ec2.internal

openshift-ingress

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44 to ip-10-0-132-9.ec2.internal

openshift-ingress

kube-auth-proxy-7b66dcfb4c-h7zvs

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7b66dcfb4c-h7zvs to ip-10-0-132-9.ec2.internal

openshift-ingress

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

Scheduled

Successfully assigned openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5 to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw to ip-10-0-129-205.ec2.internal

openshift-ingress

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Scheduled

Successfully assigned openshift-ingress/e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t to ip-10-0-132-9.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7 to ip-10-0-129-205.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v to ip-10-0-132-9.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-858dfcf476 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-858dfcf476

FailedCreate

Error creating: pods "router-default-858dfcf476-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-858dfcf476

FailedCreate

Error creating: pods "router-default-858dfcf476-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-858dfcf476

SuccessfulCreate

Created pod: router-default-858dfcf476-rkhcs
(x6)

openshift-ingress

kubelet

router-default-858dfcf476-rkhcs

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-858dfcf476-rkhcs

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-858dfcf476-rkhcs

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-858dfcf476-rkhcs

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-858dfcf476-rkhcs

Created

Created container: router

openshift-ingress

kubelet

router-default-858dfcf476-rkhcs

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7b66dcfb4c from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7b66dcfb4c

FailedCreate

Error creating: pods "kube-auth-proxy-7b66dcfb4c-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7b66dcfb4c

SuccessfulCreate

Created pod: kube-auth-proxy-7b66dcfb4c-2t28m

openshift-ingress

replicaset-controller

kube-auth-proxy-7b66dcfb4c

SuccessfulCreate

Created pod: kube-auth-proxy-7b66dcfb4c-h7zvs

openshift-ingress

multus

kube-auth-proxy-7b66dcfb4c-h7zvs

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-h7zvs

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-2t28m

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7b66dcfb4c-2t28m

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-zbwms

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-zbwms

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zbwms

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-h7zvs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.347s (3.347s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-h7zvs

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-h7zvs

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-2t28m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.624s (3.624s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-2t28m

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7b66dcfb4c-2t28m

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zbwms

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zbwms

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.172s (4.172s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zbwms

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zbwms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zbwms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c47gnt

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c47gnt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c47gnt

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c47gnt

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c47gnt

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.907s (2.907s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c47gnt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.758s (2.758s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-2vl8j

Killing

Stopping container istio-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-wptls

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-wptls

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wptls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wptls

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wptls

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wptls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wptls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zbwms

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-zbwms

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-tszg8

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-tszg8

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-9zkpq

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-zwf8d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zwf8d

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-zwf8d

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9zkpq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-9zkpq

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zwf8d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zwf8d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.587s (2.587s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-zwf8d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9zkpq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9zkpq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.478s (2.478s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9zkpq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tszg8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tszg8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tszg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tszg8

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-tszg8

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-aca190

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-aca190

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-46ccbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-46ccbd

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-4bb29c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-4bb29c

openshift-ingress

deployment-controller

e2e-worker-w0-46ccbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-4bb29c-openshift-default-688994996

SuccessfulCreate

Created pod: e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

openshift-ingress

deployment-controller

e2e-worker-w4-4bb29c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4bb29c-openshift-default-688994996 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6

SuccessfulCreate

Created pod: e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

openshift-ingress

deployment-controller

e2e-inf-a-aca190-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-aca190-openshift-default-6577fd8bdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-aca190-openshift-default-6577fd8bdd

SuccessfulCreate

Created pod: e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

openshift-ingress

multus

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.651s (2.652s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-aca190

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-aca190-6f9ff77bd7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-aca190-6f9ff77bd7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-aca190-6f9ff77bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-aca190: serviceaccount "payload-processing-e2e-inf-a-aca190" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-aca190

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-aca190: serviceaccount "payload-processing-e2e-inf-a-aca190" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-aca190-6f9ff77bd7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p

openshift-ingress

kubelet

payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-46ccbd: serviceaccount "payload-processing-e2e-worker-w0-46ccbd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-46ccbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-46ccbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-46ccbd-6f9668d87f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-46ccbd: serviceaccount "payload-processing-e2e-worker-w0-46ccbd" not found

openshift-ingress

gateway_labeler_controller

e2e-autores-14f2a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-14f2a6

openshift-ingress

deployment-controller

e2e-autores-14f2a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-14f2a6-openshift-default-55c76864b from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-14f2a6-openshift-default-55c76864b

SuccessfulCreate

Created pod: e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5

openshift-ingress

multus

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-4bb29c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-4bb29c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-4bb29c-595c45d8c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4bb29c: serviceaccount "payload-processing-e2e-worker-w4-4bb29c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.318s (2.318s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.614s (2.614s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4bb29c: serviceaccount "payload-processing-e2e-worker-w4-4bb29c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-4e1907f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4e1907f7

openshift-ingress

deployment-controller

e2e-ait-4e1907f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4e1907f7-openshift-default-6467649b6b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-4e1907f7-openshift-default-6467649b6b

SuccessfulCreate

Created pod: e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

openshift-ingress

multus

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

Started

Started container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-14f2a6-85c8d4d7bf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-14f2a6-85c8d4d7bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-14f2a6: serviceaccount "payload-processing-e2e-autores-14f2a6" not found

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-1e5db0

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-1e5db0-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-1e5db0-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-b-1e5db0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-1e5db0

openshift-ingress

deployment-controller

e2e-inf-b-1e5db0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-1e5db0-openshift-default-5f894864b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-1e5db0-openshift-default-5f894864b

SuccessfulCreate

Created pod: e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

openshift-ingress

deployment-controller

payload-processing-e2e-autores-14f2a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-14f2a6-85c8d4d7bf from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-14f2a6-6859c994c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-14f2a6-6859c994c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-14f2a6: serviceaccount "payload-processing-e2e-autores-14f2a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-14f2a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-14f2a6-6859c994c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-14f2a6-6859c994c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d

openshift-ingress

multus

payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-14f2a6-85c8d4d7bf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98

openshift-ingress

multus

payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4e1907f7: serviceaccount "payload-processing-e2e-ait-4e1907f7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4e1907f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4e1907f7-678787588f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4e1907f7-678787588f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4e1907f7-678787588f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4e1907f7: serviceaccount "payload-processing-e2e-ait-4e1907f7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4e1907f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-4e1907f7-678787588f-6pl87

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4e1907f7-678787588f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4e1907f7-678787588f-6pl87

openshift-ingress

multus

payload-processing-e2e-ait-4e1907f7-678787588f-6pl87

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4e1907f7-678787588f-6pl87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-4e1907f7-678787588f-6pl87

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1e5db0-697b97ff69

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-1e5db0-697b97ff69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1e5db0: serviceaccount "payload-processing-e2e-inf-b-1e5db0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1e5db0: serviceaccount "payload-processing-e2e-inf-b-1e5db0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-1e5db0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-1e5db0-697b97ff69 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-1e5db0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1e5db0-697b97ff69

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-4e1907f7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-4e1907f7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 30aa94f1-5d98-4780-ac57-e5347e553012, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4e1907f7-678787588f-6pl87

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4e1907f7-openshift-default-6467649b6b-gwxkd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-6d94e3f8-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-6d94e3f8-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-6d94e3f8-gw

openshift-ingress

replicaset-controller

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b

SuccessfulCreate

Created pod: e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

openshift-ingress

multus

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-6d94e3f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6d94e3f8: serviceaccount "payload-processing-e2e-migrate-6d94e3f8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t

openshift-ingress

multus

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6d94e3f8: serviceaccount "payload-processing-e2e-migrate-6d94e3f8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-6d94e3f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6d94e3f8-85c8b85fcd-qmq2v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6d94e3f8-6c8c8fcd86-9r48t

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-1a60997c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1a60997c-openshift-default-dcf575ccb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-1a60997c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1a60997c

openshift-ingress

replicaset-controller

e2e-ait-1a60997c-openshift-default-dcf575ccb

SuccessfulCreate

Created pod: e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1a60997c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1a60997c-fcc6886f4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn

openshift-ingress

multus

payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1a60997c: serviceaccount "payload-processing-e2e-ait-1a60997c" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1a60997c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1a60997c-8c4dccfdc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1a60997c-8c4dccfdc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1a60997c-8c4dccfdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1a60997c: serviceaccount "payload-processing-e2e-ait-1a60997c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1a60997c-8c4dccfdc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h
(x2)

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1a60997c-fcc6886f4-cf6qn

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-1a60997c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-1a60997c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-1a60997c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-1a60997c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8476e81e-f1e8-4679-9fdb-1308651d4d94, UID in object meta:

openshift-ingress

deployment-controller

e2e-derive-4985b031-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-4985b031-openshift-default-56455484d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-4985b031-openshift-default-56455484d8

SuccessfulCreate

Created pod: e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-4985b031

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-4985b031

openshift-ingress

multus

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-1a60997c-openshift-default-dcf575ccb-hjdw9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-4985b031

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-4985b031-69fd474d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4985b031-69fd474d86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4985b031-6c99c746b5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4985b031-6c99c746b5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-4985b031-6c99c746b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4985b031: serviceaccount "payload-processing-e2e-derive-4985b031" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4985b031-69fd474d86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-4985b031-69fd474d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4985b031: serviceaccount "payload-processing-e2e-derive-4985b031" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-4985b031

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-4985b031-6c99c746b5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-14f2a6-85c8d4d7bf-f8j98

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:34120->10.134.0.55:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:34120->10.134.0.55:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4985b031-69fd474d86-l7glk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-4985b031-openshift-default-dockercfg-bfbwc); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-derive-4985b031-openshift-default-56455484d8-nxkn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-14f2a6-openshift-default-55c76864b-gdt7t

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-4678b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-4678b2

openshift-ingress

replicaset-controller

e2e-explicit-4678b2-openshift-default-7d77f8d948

SuccessfulCreate

Created pod: e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

openshift-ingress

deployment-controller

e2e-explicit-4678b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-4678b2-openshift-default-7d77f8d948 from 0 to 1

openshift-ingress

multus

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-4678b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-4678b2-58686f4f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4678b2-58686f4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-4678b2-58686f4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4678b2: serviceaccount "payload-processing-e2e-explicit-4678b2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4678b2-6d48479769

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-4678b2-6d48479769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4678b2: serviceaccount "payload-processing-e2e-explicit-4678b2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4678b2-58686f4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4678b2-6d48479769

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-4678b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-4678b2-6d48479769 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-ab3aa7c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ab3aa7c0

openshift-ingress

replicaset-controller

e2e-mt-ab3aa7c0-openshift-default-7bc86454d

SuccessfulCreate

Created pod: e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

openshift-ingress

deployment-controller

e2e-mt-ab3aa7c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ab3aa7c0-openshift-default-7bc86454d from 0 to 1

openshift-ingress

multus

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ab3aa7c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ab3aa7c0: serviceaccount "payload-processing-e2e-mt-ab3aa7c0" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ab3aa7c0: serviceaccount "payload-processing-e2e-mt-ab3aa7c0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ab3aa7c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp

openshift-ingress

kubelet

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab3aa7c0-85858c885d-xxcpp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4678b2-6d48479769-6k6wt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4678b2-58686f4f8-l2xtj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-2b6ce0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-2b6ce0-openshift-default-56dfc46748 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-2b6ce0-openshift-default-56dfc46748

SuccessfulCreate

Created pod: e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf

openshift-ingress

gateway_labeler_controller

e2e-noten-2b6ce0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-2b6ce0

openshift-ingress

kubelet

e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-aff7af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-aff7af-openshift-default-57d545448 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-aff7af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-aff7af

openshift-ingress

replicaset-controller

e2e-shared-a-w2-aff7af-openshift-default-57d545448

SuccessfulCreate

Created pod: e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af: serviceaccount "payload-processing-e2e-shared-a-w2-aff7af" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-aff7af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af: serviceaccount "payload-processing-e2e-shared-a-w2-aff7af" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-aff7af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-aff7af-56f9b97967 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-w2-f2afd5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f2afd5-openshift-default-555797549b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f2afd5-openshift-default-555797549b

SuccessfulCreate

Created pod: e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f2afd5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f2afd5
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f2afd5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f2afd5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5: serviceaccount "payload-processing-e2e-shared-b-w2-f2afd5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5: serviceaccount "payload-processing-e2e-shared-b-w2-f2afd5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-aca190-openshift-default-6577fd8bdd-jg6tv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1e5db0-697b97ff69-7zpn5

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-973610-openshift-default-59d86896d4

SuccessfulCreate

Created pod: e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

openshift-ingress

multus

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-973610-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-973610-openshift-default-59d86896d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-973610

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-973610
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-1e5db0-openshift-default-5f894864b-htdrt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-c5dc2482-openshift-default-5dfc494ddd

SuccessfulCreate

Created pod: e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-973610

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-973610-5866764647 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg

openshift-ingress

deployment-controller

e2e-mt-c5dc2482-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c5dc2482-openshift-default-5dfc494ddd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-c5dc2482

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c5dc2482
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-973610: serviceaccount "payload-processing-e2e-shared-a-w3-973610" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-973610-5866764647

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-973610

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-973610-5866764647

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-973610-5866764647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-973610: serviceaccount "payload-processing-e2e-shared-a-w3-973610" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v

Created

Created container: payload-processing

openshift-ingress

multus

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c5dc2482-565d998589

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c5dc2482-565d998589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c5dc2482: serviceaccount "payload-processing-e2e-mt-c5dc2482" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c5dc2482: serviceaccount "payload-processing-e2e-mt-c5dc2482" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c5dc2482

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c5dc2482-f6585cffd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c5dc2482-565d998589

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c5dc2482

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c5dc2482-565d998589 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

multus

payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-8c36a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-8c36a6

openshift-ingress

replicaset-controller

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96

SuccessfulCreate

Created pod: e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

openshift-ingress

deployment-controller

e2e-shared-b-w3-8c36a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-8c36a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-8c36a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-8c36a6-78646b695f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6: serviceaccount "payload-processing-e2e-shared-b-w3-8c36a6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6: serviceaccount "payload-processing-e2e-shared-b-w3-8c36a6" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-c5dc2482-565d998589-bzl9l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-c5dc2482-openshift-default-5dfc494ddd-bfdzs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-bdd04e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-bdd04e-openshift-default-85b89d85c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-bdd04e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-bdd04e

openshift-ingress

replicaset-controller

e2e-api-a-bdd04e-openshift-default-85b89d85c8

SuccessfulCreate

Created pod: e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

openshift-ingress

multus

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-bdd04e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-bdd04e-6fd4477db9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-bdd04e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv

openshift-ingress

multus

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bdd04e: serviceaccount "payload-processing-e2e-api-a-bdd04e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bdd04e-6fd4477db9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bdd04e-6fd4477db9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-bdd04e-6fd4477db9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bdd04e: serviceaccount "payload-processing-e2e-api-a-bdd04e" not found

openshift-ingress

deployment-controller

e2e-api-b-59a5a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-59a5a8-openshift-default-56f7c74c7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-59a5a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-59a5a8

openshift-ingress

replicaset-controller

e2e-api-b-59a5a8-openshift-default-56f7c74c7b

SuccessfulCreate

Created pod: e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

openshift-ingress

multus

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-59a5a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-59a5a8-5db55c98c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-59a5a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-59a5a8-648884dcd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-59a5a8: serviceaccount "payload-processing-e2e-api-b-59a5a8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-59a5a8-5db55c98c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-59a5a8-5db55c98c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-59a5a8-5db55c98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-59a5a8: serviceaccount "payload-processing-e2e-api-b-59a5a8" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-46ccbd-6f48d85c5d-djsgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-bdd04e-openshift-default-85b89d85c8-zks29

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-59a5a8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-59a5a8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 63dfa83a-e326-4ab8-a5d1-157b65d24a98, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-59a5a8-openshift-default-56f7c74c7b-p942l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-4bb29c-openshift-default-688994996-5vzvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f2afd5-openshift-default-555797549b-j96v8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b59887

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b59887

openshift-ingress

multus

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-b59887-openshift-default-8b9cccd96

SuccessfulCreate

Created pod: e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

openshift-ingress

deployment-controller

e2e-ipp-a-b59887-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b59887-openshift-default-8b9cccd96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b59887

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b59887: serviceaccount "payload-processing-e2e-ipp-a-b59887" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b59887

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b59887-6c5c9f74bc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b59887: serviceaccount "payload-processing-e2e-ipp-a-b59887" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ac4a3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ac4a3c

openshift-ingress

replicaset-controller

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb

SuccessfulCreate

Created pod: e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

openshift-ingress

deployment-controller

e2e-ipp-b-ac4a3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb from 0 to 1

openshift-ingress

multus

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ac4a3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ac4a3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ac4a3c-7d699f4657 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c: serviceaccount "payload-processing-e2e-ipp-b-ac4a3c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c: serviceaccount "payload-processing-e2e-ipp-b-ac4a3c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

Unhealthy

Readiness probe failed: Get "http://10.133.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

ProbeError

Readiness probe error: Get "http://10.133.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-bf580f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-bf580f

openshift-ingress

deployment-controller

e2e-ipp-cleanup-bf580f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

openshift-ingress

multus

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-bf580f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-bf580f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f: serviceaccount "payload-processing-e2e-ipp-cleanup-bf580f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f: serviceaccount "payload-processing-e2e-ipp-cleanup-bf580f" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-bf580f-openshift-default-c846bc6bb-hng44

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b59887-df5cd65c4-fg4zs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b59887-6c5c9f74bc-8hh4d

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-b59887

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-b59887: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-b59887": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-b59887, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 170d7437-8134-4be7-826d-c30a7e08dd36, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-ac4a3c-openshift-default-5499cb4fdb-ts845

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-973610-5866764647-pss5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-8c36a6-openshift-default-77c8678c96-n9vq9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: