Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-64e462-openshift-default-67664986bd-989bb to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq to ip-10-0-140-187.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-svr8q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-svr8q to ip-10-0-141-128.ec2.internal

openshift-ingress

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb to ip-10-0-141-128.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr to ip-10-0-141-128.ec2.internal

openshift-ingress

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2 to ip-10-0-134-179.ec2.internal

openshift-ingress

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44 to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6 to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg to ip-10-0-134-179.ec2.internal

openshift-ingress

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7 to ip-10-0-134-179.ec2.internal

openshift-ingress

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6 to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw to ip-10-0-134-179.ec2.internal

openshift-ingress

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984 to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76 to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85 to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-829959-openshift-default-697f5547d4-mdscp to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788 to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr to ip-10-0-134-179.ec2.internal

openshift-ingress

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh to ip-10-0-141-128.ec2.internal

openshift-ingress

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-593845-openshift-default-54dcc87546-pvswg to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7 to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598 to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-p2vwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-p2vwz to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h to ip-10-0-134-179.ec2.internal

openshift-ingress

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z to ip-10-0-134-179.ec2.internal

openshift-ingress

router-default-57b84c8474-8xjql

Scheduled

Successfully assigned openshift-ingress/router-default-57b84c8474-8xjql to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg to ip-10-0-134-179.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-m9kwv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-m9kwv to ip-10-0-141-128.ec2.internal

openshift-ingress

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8 to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh to ip-10-0-141-128.ec2.internal

openshift-ingress

kube-auth-proxy-76b8774589-g78ps

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-76b8774589-g78ps to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22 to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl to ip-10-0-141-128.ec2.internal

openshift-ingress

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8 to ip-10-0-134-179.ec2.internal

openshift-ingress

kube-auth-proxy-76b8774589-59jxv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-76b8774589-59jxv to ip-10-0-141-128.ec2.internal

openshift-ingress

e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf

Scheduled

Successfully assigned openshift-ingress/e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf to ip-10-0-141-128.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-q8zww

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-q8zww to ip-10-0-140-187.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-btmpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-btmpn to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx to ip-10-0-140-187.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm to ip-10-0-134-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448 to ip-10-0-140-187.ec2.internal

openshift-ingress

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

Scheduled

Successfully assigned openshift-ingress/e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm to ip-10-0-141-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p to ip-10-0-141-128.ec2.internal
(x8)

openshift-ingress

replicaset-controller

router-default-57b84c8474

FailedCreate

Error creating: pods "router-default-57b84c8474-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-57b84c8474 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-57b84c8474

FailedCreate

Error creating: pods "router-default-57b84c8474-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-57b84c8474

SuccessfulCreate

Created pod: router-default-57b84c8474-8xjql
(x5)

openshift-ingress

kubelet

router-default-57b84c8474-8xjql

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-57b84c8474-8xjql

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-57b84c8474-8xjql

Created

Created container: router

openshift-ingress

multus

router-default-57b84c8474-8xjql

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-57b84c8474-8xjql

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-57b84c8474-8xjql

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-76b8774589 from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-76b8774589

FailedCreate

Error creating: pods "kube-auth-proxy-76b8774589-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-76b8774589

SuccessfulCreate

Created pod: kube-auth-proxy-76b8774589-59jxv

openshift-ingress

replicaset-controller

kube-auth-proxy-76b8774589

SuccessfulCreate

Created pod: kube-auth-proxy-76b8774589-g78ps

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-59jxv

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-g78ps

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-76b8774589-g78ps

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-g78ps

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-76b8774589-59jxv

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-59jxv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-q8zww

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-q8zww

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q8zww

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-g78ps

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-59jxv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-59jxv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q8zww

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q8zww

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-g78ps

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q8zww

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.559s (2.559s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-59jxv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.769s (2.769s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-76b8774589-g78ps

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.815s (2.815s including waiting). Image size: 265120132 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q8zww

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q8zww

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tmqfm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.687s (2.687s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-m9kwv

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-m9kwv

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m9kwv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m9kwv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.491s (2.491s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m9kwv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m9kwv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m9kwv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-m9kwv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-q8zww

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-q8zww

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-svr8q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-svr8q

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-svr8q

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-svr8q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.861s (2.861s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-btmpn
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-p2vwz

openshift-ingress

multus

payload-processing-5b54b7fbb7-btmpn

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-p2vwz

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-p2vwz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-btmpn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-p2vwz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.803s (3.803s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-p2vwz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-btmpn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.788s (3.788s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-btmpn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-btmpn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-p2vwz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-svr8q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-svr8q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-svr8q

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-svr8q

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-svr8q

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-139288-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-139288-openshift-default-8557bc4874 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-139288-openshift-default-8557bc4874

SuccessfulCreate

Created pod: e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-139288

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-139288

openshift-ingress

deployment-controller

e2e-inf-a-a4df66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a4df66-openshift-default-7cc987766d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a4df66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a4df66

openshift-ingress

replicaset-controller

e2e-worker-w0-3c466c-openshift-default-74b6fd8454

SuccessfulCreate

Created pod: e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

openshift-ingress

deployment-controller

e2e-worker-w0-3c466c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3c466c-openshift-default-74b6fd8454 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-3c466c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-3c466c

openshift-ingress

replicaset-controller

e2e-inf-a-a4df66-openshift-default-7cc987766d

SuccessfulCreate

Created pod: e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

openshift-ingress

multus

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a4df66-869f445c87

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a4df66-869f445c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a4df66: serviceaccount "payload-processing-e2e-inf-a-a4df66" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a4df66: serviceaccount "payload-processing-e2e-inf-a-a4df66" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a4df66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a4df66-869f445c87

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a4df66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a4df66-869f445c87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3c466c-59bdd48b77

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-3c466c-59bdd48b77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3c466c: serviceaccount "payload-processing-e2e-worker-w0-3c466c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3c466c-59bdd48b77

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-3c466c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-3c466c-59bdd48b77 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-3c466c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-3c466c-7445648d54 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.268s (1.268s including waiting). Image size: 166449312 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3c466c: serviceaccount "payload-processing-e2e-worker-w0-3c466c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-139288-664fd6dffc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-139288-664fd6dffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-139288: serviceaccount "payload-processing-e2e-worker-w4-139288" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-139288-664fd6dffc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-139288

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-139288-664fd6dffc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-autores-4aaf1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4aaf1a

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-139288: serviceaccount "payload-processing-e2e-worker-w4-139288" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-139288

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-139288-666ffbb86b from 0 to 1

openshift-ingress

multus

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-4aaf1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4aaf1a-openshift-default-75d6b5f594 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-4aaf1a-openshift-default-75d6b5f594

SuccessfulCreate

Created pod: e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

openshift-ingress

gateway_labeler_controller

e2e-ait-1b1c80d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1b1c80d8

openshift-ingress

deployment-controller

e2e-ait-1b1c80d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b

SuccessfulCreate

Created pod: e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

openshift-ingress

multus

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4aaf1a-86d778858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-4aaf1a-86d778858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4aaf1a: serviceaccount "payload-processing-e2e-autores-4aaf1a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-4aaf1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-4aaf1a-86d778858 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-4aaf1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-4aaf1a-84f46c6b85 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4aaf1a-84f46c6b85

FailedCreate

Error creating: pods "payload-processing-e2e-autores-4aaf1a-84f46c6b85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4aaf1a: serviceaccount "payload-processing-e2e-autores-4aaf1a" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1b1c80d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4aaf1a-86d778858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4aaf1a-84f46c6b85

SuccessfulCreate

Created pod: payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

openshift-ingress

multus

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1b1c80d8: serviceaccount "payload-processing-e2e-ait-1b1c80d8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1b1c80d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1b1c80d8: serviceaccount "payload-processing-e2e-ait-1b1c80d8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

ProbeError

Readiness probe error: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

Unhealthy

Readiness probe failed: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.41s (1.41s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-39d42b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-39d42b
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

Started

Started container istio-proxy

openshift-ingress

multus

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-39d42b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-39d42b-openshift-default-5658d889b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-39d42b-openshift-default-5658d889b8

SuccessfulCreate

Created pod: e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8
(x6)

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-39d42b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-39d42b-55fc64bff5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-39d42b-55fc64bff5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-39d42b-55fc64bff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-39d42b: serviceaccount "payload-processing-e2e-inf-b-39d42b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-39d42b-55fc64bff5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-39d42b: serviceaccount "payload-processing-e2e-inf-b-39d42b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-39d42b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-1b1c80d8-openshift-default-d6c5c7f6b-jh7z2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-1b1c80d8-5ddcb5c66f-77xmg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b1c80d8-57bf44c4f4-lrk22

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d

SuccessfulCreate

Created pod: e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

openshift-ingress

deployment-controller

e2e-migrate-e6d0c6f2-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-e6d0c6f2-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e6d0c6f2-gw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e6d0c6f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e6d0c6f2-555447fffd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e6d0c6f2-555447fffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e6d0c6f2: serviceaccount "payload-processing-e2e-migrate-e6d0c6f2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e6d0c6f2: serviceaccount "payload-processing-e2e-migrate-e6d0c6f2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e6d0c6f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e6d0c6f2-555447fffd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s

openshift-ingress

kubelet

payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e6d0c6f2-555447fffd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-e6d0c6f2-gw-openshift-default-64fc5dd48d-z6r8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e6d0c6f2-57c7f74fc4-mnk9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e6d0c6f2-555447fffd-mpd5r

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-6cbdb29e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6cbdb29e

openshift-ingress

deployment-controller

e2e-ait-6cbdb29e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6cbdb29e-openshift-default-869ccf6ffd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd

SuccessfulCreate

Created pod: e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

openshift-ingress

multus

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6cbdb29e-5ff6769957

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6cbdb29e-5ff6769957-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6cbdb29e: serviceaccount "payload-processing-e2e-ait-6cbdb29e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6cbdb29e-5ff6769957

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6cbdb29e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6cbdb29e: serviceaccount "payload-processing-e2e-ait-6cbdb29e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6cbdb29e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6cbdb29e-5ff6769957 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-6cbdb29e-5ff6769957-whtjw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cbdb29e-6b8974b958-868qv

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-6cbdb29e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-6cbdb29e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-6cbdb29e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-6cbdb29e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a05f548d-b25b-45d8-9a4e-98e5b4894ca2, UID in object meta:

openshift-ingress

replicaset-controller

e2e-derive-9c414efe-openshift-default-69dd7c69b8

SuccessfulCreate

Created pod: e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

openshift-ingress

gateway_labeler_controller

e2e-derive-9c414efe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9c414efe

openshift-ingress

deployment-controller

e2e-derive-9c414efe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-9c414efe-openshift-default-69dd7c69b8 from 0 to 1

openshift-ingress

kubelet

e2e-ait-6cbdb29e-openshift-default-869ccf6ffd-w7ksk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-processing-e2e-autores-4aaf1a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-autores-4aaf1a: Operation cannot be fulfilled on endpoints "payload-processing-e2e-autores-4aaf1a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-autores-4aaf1a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3e21f70e-ca3c-498d-9f1c-4df0a988f757, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4aaf1a-86d778858-d5xcf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4aaf1a-84f46c6b85-wjjsx

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-derive-9c414efe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-9c414efe-74dbd86f6f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9c414efe-74dbd86f6f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9c414efe-74dbd86f6f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-9c414efe-74dbd86f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9c414efe: serviceaccount "payload-processing-e2e-derive-9c414efe" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-9c414efe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-9c414efe-7876dfb886 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9c414efe-7876dfb886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9c414efe-7876dfb886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-9c414efe-7876dfb886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9c414efe: serviceaccount "payload-processing-e2e-derive-9c414efe" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-autores-4aaf1a-openshift-default-75d6b5f594-txrrj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-03e1dc-openshift-default-86cc87b4b4

SuccessfulCreate

Created pod: e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

openshift-ingress

deployment-controller

e2e-explicit-03e1dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-03e1dc-openshift-default-86cc87b4b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-03e1dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-03e1dc
(x2)

openshift-ingress

kubelet

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-03e1dc-674d4b6597

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-03e1dc-674d4b6597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-03e1dc: serviceaccount "payload-processing-e2e-explicit-03e1dc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-03e1dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-03e1dc: serviceaccount "payload-processing-e2e-explicit-03e1dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-03e1dc-674d4b6597

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-03e1dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-03e1dc-674d4b6597 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9c414efe-7876dfb886-4mflb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-9c414efe

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-9c414efe: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-9c414efe": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-9c414efe, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0aa2dfcc-e4f9-475d-9768-1998bec27079, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-9c414efe-74dbd86f6f-gg4t6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-9c414efe-openshift-default-69dd7c69b8-ll5vt

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-03e1dc-5dff4957c8-mz86p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-03e1dc-674d4b6597-nndmq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-0a0781-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-0a0781-openshift-default-86b89df9c8 from 0 to 1

openshift-ingress

multus

e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-0a0781

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-0a0781

openshift-ingress

replicaset-controller

e2e-noten-0a0781-openshift-default-86b89df9c8

SuccessfulCreate

Created pod: e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf

openshift-ingress

kubelet

e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-03e1dc-openshift-default-86cc87b4b4-298lr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-d370bb1a-openshift-default-6959cdb6c6

SuccessfulCreate

Created pod: e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

openshift-ingress

deployment-controller

e2e-mt-d370bb1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d370bb1a-openshift-default-6959cdb6c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-d370bb1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d370bb1a

openshift-ingress

multus

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d370bb1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d370bb1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d370bb1a-85cf464cdf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d370bb1a-85cf464cdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d370bb1a-85cf464cdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d370bb1a-85cf464cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d370bb1a: serviceaccount "payload-processing-e2e-mt-d370bb1a" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d370bb1a: serviceaccount "payload-processing-e2e-mt-d370bb1a" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d370bb1a-59fff5bb86-xcc44

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d370bb1a-85cf464cdf-mgcsn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-d370bb1a-openshift-default-6959cdb6c6-vz74b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-0d3a66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-0d3a66

openshift-ingress

deployment-controller

e2e-shared-a-w2-0d3a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6

SuccessfulCreate

Created pod: e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

openshift-ingress

multus

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-0d3a66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-0d3a66-854748765c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-0d3a66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-0d3a66-854748765c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-0d3a66-854748765c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-0d3a66-854748765c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-0d3a66: serviceaccount "payload-processing-e2e-shared-a-w2-0d3a66" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-0d3a66: serviceaccount "payload-processing-e2e-shared-a-w2-0d3a66" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a4df66-869f445c87-cq5cp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a4df66-7dd5b76c4-vqffm

Unhealthy

Readiness probe failed: dial tcp 10.132.0.43:9004: i/o timeout

openshift-ingress

deployment-controller

e2e-shared-b-w2-f12ab7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f12ab7-openshift-default-678468bf74 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f12ab7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f12ab7

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74

SuccessfulCreate

Created pod: e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

openshift-ingress

multus

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-0a0781-openshift-default-86b89df9c8-rc2kf

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f12ab7: serviceaccount "payload-processing-e2e-shared-b-w2-f12ab7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f12ab7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f12ab7: serviceaccount "payload-processing-e2e-shared-b-w2-f12ab7" not found
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f12ab7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-a4df66-openshift-default-7cc987766d-5t9vl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-cfdf5d6c-openshift-default-67c67769fb

SuccessfulCreate

Created pod: e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

openshift-ingress

deployment-controller

e2e-mt-cfdf5d6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cfdf5d6c-openshift-default-67c67769fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-cfdf5d6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cfdf5d6c

openshift-ingress

multus

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cfdf5d6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cfdf5d6c-7745598cd5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cfdf5d6c: serviceaccount "payload-processing-e2e-mt-cfdf5d6c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cfdf5d6c-7745598cd5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cfdf5d6c-7745598cd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cfdf5d6c: serviceaccount "payload-processing-e2e-mt-cfdf5d6c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cfdf5d6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cfdf5d6c-7745598cd5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n

openshift-ingress

kubelet

payload-processing-e2e-inf-b-39d42b-55fc64bff5-cw8nr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-39d42b-6b8b9865d6-fmd76

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-39d42b-openshift-default-5658d889b8-kw9n8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-e88680-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e88680-openshift-default-74bc5c555d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-e88680

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-e88680

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d

SuccessfulCreate

Created pod: e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

openshift-ingress

multus

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3c466c-7445648d54-7tl8k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3c466c-59bdd48b77-sv6rh

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e88680: serviceaccount "payload-processing-e2e-shared-a-w3-e88680" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-e88680

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-e88680-7df4f5564f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e88680: serviceaccount "payload-processing-e2e-shared-a-w3-e88680" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-e88680

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3c466c-openshift-default-74b6fd8454-xx9jz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e37bfb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e37bfb

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6

SuccessfulCreate

Created pod: e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

openshift-ingress

deployment-controller

e2e-shared-b-w3-e37bfb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e37bfb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e37bfb: serviceaccount "payload-processing-e2e-shared-b-w3-e37bfb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e37bfb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e37bfb: serviceaccount "payload-processing-e2e-shared-b-w3-e37bfb" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cfdf5d6c-7745598cd5-dls2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cfdf5d6c-8cd6d5b66-qdmdf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cfdf5d6c-openshift-default-67c67769fb-pjmx8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-829959

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-829959

openshift-ingress

deployment-controller

e2e-api-a-829959-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-829959-openshift-default-697f5547d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-829959-openshift-default-697f5547d4

SuccessfulCreate

Created pod: e2e-api-a-829959-openshift-default-697f5547d4-mdscp

openshift-ingress

multus

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-829959

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-829959-68c9cb8cd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-829959-68c9cb8cd7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-829959

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-829959-89589dff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-829959-89589dff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-829959-89589dff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-829959-89589dff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-829959: serviceaccount "payload-processing-e2e-api-a-829959" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-829959-68c9cb8cd7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-829959-68c9cb8cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-829959: serviceaccount "payload-processing-e2e-api-a-829959" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-593845-openshift-default-54dcc87546

SuccessfulCreate

Created pod: e2e-api-b-593845-openshift-default-54dcc87546-pvswg

openshift-ingress

deployment-controller

e2e-api-b-593845-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-593845-openshift-default-54dcc87546 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-593845

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-593845

openshift-ingress

multus

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-593845

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-593845-6cbbb9c6b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-593845-6cbbb9c6b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-593845-6cbbb9c6b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-593845-6cbbb9c6b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-593845: serviceaccount "payload-processing-e2e-api-b-593845" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-593845

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-593845-6976cbf4f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-593845-6976cbf4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-593845-6976cbf4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-593845-6976cbf4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-593845: serviceaccount "payload-processing-e2e-api-b-593845" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-139288-666ffbb86b-6jl85

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-139288-664fd6dffc-9bb8h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-139288-openshift-default-8557bc4874-7zvml

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-829959-89589dff4-vjfjk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-829959-68c9cb8cd7-7sbpg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-829959-openshift-default-697f5547d4-mdscp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-593845-6cbbb9c6b9-l96kg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-593845-6976cbf4f8-b5448

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-593845-openshift-default-54dcc87546-pvswg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0d3a66-854748765c-4g6kq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-0d3a66

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0d3a66: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-0d3a66": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0d3a66, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ece7bead-d035-45d4-b5f1-558df0b044cc, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0d3a66-9874b58d6-m2bp6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-0d3a66-openshift-default-6c7595fdd6-f92vh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f12ab7-6bdf9c9f7c-dwjcr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f12ab7-59b8766c78-m6swk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-f12ab7-openshift-default-678468bf74-42mbj

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-ipp-a-64e462-openshift-default-67664986bd

SuccessfulCreate

Created pod: e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

openshift-ingress

deployment-controller

e2e-ipp-a-64e462-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-64e462-openshift-default-67664986bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-64e462

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-64e462

openshift-ingress

multus

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-64e462

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-64e462-5857b6f555 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-64e462: serviceaccount "payload-processing-e2e-ipp-a-64e462" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-64e462-5857b6f555

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-64e462

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-64e462-5857b6f555

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-64e462-5857b6f555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-64e462: serviceaccount "payload-processing-e2e-ipp-a-64e462" not found

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-1cbe1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-1cbe1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1cbe1c

openshift-ingress

replicaset-controller

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d

SuccessfulCreate

Created pod: e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

openshift-ingress

multus

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1cbe1c: serviceaccount "payload-processing-e2e-ipp-b-1cbe1c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1cbe1c: serviceaccount "payload-processing-e2e-ipp-b-1cbe1c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1cbe1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1cbe1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b4b570

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b4b570

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

openshift-ingress

multus

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b4b570-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b4b570: serviceaccount "payload-processing-e2e-ipp-cleanup-b4b570" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b4b570

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b4b570

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b4b570: serviceaccount "payload-processing-e2e-ipp-cleanup-b4b570" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b4b570-9ccbbb667-4x2q7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b4b570-94b4f9bc8-6txkd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-b4b570-openshift-default-86b7f9547b-5pgkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64e462-5d477bdf5d-9k6wx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64e462-5857b6f555-wds5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-64e462-openshift-default-67664986bd-989bb

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-1cbe1c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-1cbe1c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-1cbe1c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-1cbe1c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0d14fcfd-c976-4273-927a-b43fe6ba8ce8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1cbe1c-bf4c474f4-sn4dd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1cbe1c-ff9cb8b89-6v598

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-1cbe1c-openshift-default-5fc97d867d-9hcqb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e88680-7df4f5564f-9d4gm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e88680-6b4bfd4874-2bnwf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-e88680-openshift-default-74bc5c555d-t5984

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e37bfb-54fd9bcc55-6x788

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e37bfb-756cdf47bb-5xkrt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-e37bfb-openshift-default-b7bf588f6-jlzn7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: