Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm to ip-10-0-133-190.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-lwtdf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf to ip-10-0-128-195.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2 to ip-10-0-143-72.ec2.internal

openshift-ingress

e2e-noten-b159da-openshift-default-788696c96-2mmrv

Scheduled

Successfully assigned openshift-ingress/e2e-noten-b159da-openshift-default-788696c96-2mmrv to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb to ip-10-0-128-195.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-586bab-89b68857c-jtc45

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-586bab-89b68857c-jtc45 to ip-10-0-143-72.ec2.internal

openshift-ingress

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49 to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8 to ip-10-0-133-190.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-t9znl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9 to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

Scheduled

Successfully assigned openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp to ip-10-0-133-190.ec2.internal

openshift-ingress

kube-auth-proxy-8568fcf948-77q2n

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8568fcf948-77q2n to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

Scheduled

Successfully assigned openshift-ingress/e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv to ip-10-0-128-195.ec2.internal

openshift-ingress

kube-auth-proxy-8568fcf948-vhx9p

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6 to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9 to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6 to ip-10-0-143-72.ec2.internal

openshift-ingress

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7 to ip-10-0-143-72.ec2.internal

openshift-ingress

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff to ip-10-0-143-72.ec2.internal

openshift-ingress

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

Scheduled

Successfully assigned openshift-ingress/e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4 to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97 to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24 to ip-10-0-133-190.ec2.internal

openshift-ingress

router-default-944d5c59d-l5g2b

Scheduled

Successfully assigned openshift-ingress/router-default-944d5c59d-l5g2b to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b to ip-10-0-143-72.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2 to ip-10-0-133-190.ec2.internal

openshift-ingress

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh to ip-10-0-128-195.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9rfz6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9rfz6 to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888 to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-hlmzd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-k2d2c

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-k2d2c to ip-10-0-128-195.ec2.internal

openshift-ingress

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr to ip-10-0-128-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2 to ip-10-0-133-190.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4 to ip-10-0-133-190.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-944d5c59d from 0 to 1
(x16)

openshift-ingress

replicaset-controller

router-default-944d5c59d

FailedCreate

Error creating: pods "router-default-944d5c59d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-944d5c59d

SuccessfulCreate

Created pod: router-default-944d5c59d-l5g2b
(x6)

openshift-ingress

kubelet

router-default-944d5c59d-l5g2b

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-944d5c59d-l5g2b

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-944d5c59d-l5g2b

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-944d5c59d-l5g2b

Created

Created container: router

openshift-ingress

kubelet

router-default-944d5c59d-l5g2b

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-944d5c59d-l5g2b

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-8568fcf948 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-8568fcf948

SuccessfulCreate

Created pod: kube-auth-proxy-8568fcf948-77q2n

openshift-ingress

replicaset-controller

kube-auth-proxy-8568fcf948

SuccessfulCreate

Created pod: kube-auth-proxy-8568fcf948-vhx9p
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-8568fcf948

FailedCreate

Error creating: pods "kube-auth-proxy-8568fcf948-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-vhx9p

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-77q2n

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-77q2n

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-vhx9p

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8568fcf948-vhx9p

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-8568fcf948-77q2n

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-lwtdf

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lwtdf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-lwtdf

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-77q2n

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-77q2n

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-77q2n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.781s (2.781s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lwtdf

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lwtdf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 6.08s (6.08s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-vhx9p

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lwtdf

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-vhx9p

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8568fcf948-vhx9p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 6.762s (6.762s including waiting). Image size: 265120132 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-t9znl

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-t9znl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-t9znl

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-t9znl

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-t9znl

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.069s (3.069s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-lwtdf

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lwtdf

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.978s (2.978s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-x225s

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

Unhealthy

Startup probe failed: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

ProbeError

Startup probe error: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfc4vm

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9rfz6

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9rfz6

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlmzd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-hlmzd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-k2d2c

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-hlmzd

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-k2d2c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-k2d2c

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlmzd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-k2d2c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-k2d2c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.734s (1.734s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlmzd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlmzd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.871s (1.871s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-k2d2c

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9rfz6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9rfz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9rfz6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9rfz6

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9rfz6

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-7d0256-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-7d0256-openshift-default-56f54765dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-490797-openshift-default-7648768bbd

SuccessfulCreate

Created pod: e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

openshift-ingress

gateway_labeler_controller

e2e-inf-a-586bab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-586bab

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-7d0256

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-7d0256

openshift-ingress

deployment-controller

e2e-inf-a-586bab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-586bab-openshift-default-5df69d64c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-586bab-openshift-default-5df69d64c8

SuccessfulCreate

Created pod: e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

openshift-ingress

replicaset-controller

e2e-worker-w4-7d0256-openshift-default-56f54765dd

SuccessfulCreate

Created pod: e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-490797

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-490797

openshift-ingress

deployment-controller

e2e-worker-w0-490797-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-490797-openshift-default-7648768bbd from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.212s (3.212s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-7d0256

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7d0256: serviceaccount "payload-processing-e2e-worker-w4-7d0256" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-7d0256

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-7d0256-85bb5876ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7d0256-85bb5876ff

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7d0256-85bb5876ff

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-7d0256-85bb5876ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7d0256: serviceaccount "payload-processing-e2e-worker-w4-7d0256" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-490797

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-490797-7b949f5899 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-490797-7b949f5899

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-490797-7b949f5899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-490797: serviceaccount "payload-processing-e2e-worker-w0-490797" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-490797

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-490797: serviceaccount "payload-processing-e2e-worker-w0-490797" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-490797-7b949f5899

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-586bab-89b68857c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-586bab-89b68857c-jtc45
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-586bab-89b68857c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-586bab-89b68857c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-586bab: serviceaccount "payload-processing-e2e-inf-a-586bab" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-586bab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-586bab-89b68857c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.39s (1.39s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-586bab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-586bab-6b6985c758 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-586bab-6b6985c758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-586bab-6b6985c758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-586bab-6b6985c758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-586bab: serviceaccount "payload-processing-e2e-inf-a-586bab" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-586bab-89b68857c-jtc45

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-79dbf9e9-openshift-default-669df67698

SuccessfulCreate

Created pod: e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

openshift-ingress

deployment-controller

e2e-ait-79dbf9e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-79dbf9e9-openshift-default-669df67698 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-79dbf9e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-79dbf9e9

openshift-ingress

GatewayAuthBootstrap

e2e-ait-79dbf9e9

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-79dbf9e9-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-79dbf9e9-authn-ssl" already exists

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-586bab-89b68857c-jtc45

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

gateway_labeler_controller

e2e-autores-a24d8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-a24d8b

openshift-ingress

kubelet

payload-processing-e2e-inf-a-586bab-89b68857c-jtc45

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-586bab-89b68857c-jtc45

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-autores-a24d8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a24d8b-openshift-default-84f4678f84 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.392s (2.392s including waiting). Image size: 166449312 bytes.

openshift-ingress

replicaset-controller

e2e-autores-a24d8b-openshift-default-84f4678f84

SuccessfulCreate

Created pod: e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

openshift-ingress

kubelet

payload-processing-e2e-inf-a-586bab-89b68857c-jtc45

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 397ms (397ms including waiting). Image size: 166449312 bytes.

openshift-ingress

multus

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-a24d8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-a24d8b-7bff5d6c55 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a24d8b-7bff5d6c55

FailedCreate

Error creating: pods "payload-processing-e2e-autores-a24d8b-7bff5d6c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a24d8b: serviceaccount "payload-processing-e2e-autores-a24d8b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-a24d8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-a24d8b-c6b7f8794 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a24d8b: serviceaccount "payload-processing-e2e-autores-a24d8b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a24d8b-7bff5d6c55

SuccessfulCreate

Created pod: payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7

openshift-ingress

multus

payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-79dbf9e9: serviceaccount "payload-processing-e2e-ait-79dbf9e9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-79dbf9e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-ait-79dbf9e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-79dbf9e9-8f68b4b69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-79dbf9e9-8f68b4b69

SuccessfulCreate

Created pod: payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-79dbf9e9-8f68b4b69

FailedCreate

Error creating: pods "payload-processing-e2e-ait-79dbf9e9-8f68b4b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-79dbf9e9: serviceaccount "payload-processing-e2e-ait-79dbf9e9" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-inf-b-89d6bf-openshift-default-65d86845db

SuccessfulCreate

Created pod: e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

openshift-ingress

deployment-controller

e2e-inf-b-89d6bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-89d6bf-openshift-default-65d86845db from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-89d6bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-89d6bf
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-89d6bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-89d6bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-89d6bf-75678b5cdf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-89d6bf-75678b5cdf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-89d6bf-75678b5cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-89d6bf: serviceaccount "payload-processing-e2e-inf-b-89d6bf" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9

openshift-ingress

multus

payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-89d6bf: serviceaccount "payload-processing-e2e-inf-b-89d6bf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-89d6bf-75678b5cdf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

ProbeError

Readiness probe error: Get "http://10.134.0.44:15021/healthz/ready": read tcp 10.134.0.2:34348->10.134.0.44:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Unhealthy

Readiness probe failed: Get "http://10.134.0.44:15021/healthz/ready": read tcp 10.134.0.2:34348->10.134.0.44:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-79dbf9e9-openshift-default-dockercfg-hpls9); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-79dbf9e9-7d59c45f4-j5mv4

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-e3535999-gw-openshift-default-786745bcb

SuccessfulCreate

Created pod: e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

openshift-ingress

deployment-controller

e2e-migrate-e3535999-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e3535999-gw-openshift-default-786745bcb from 0 to 1

openshift-ingress

kubelet

e2e-ait-79dbf9e9-openshift-default-669df67698-6mk6j

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-e3535999-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e3535999-gw
(x2)

openshift-ingress

kubelet

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e3535999

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e3535999-bb8778658 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e3535999-bb8778658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e3535999-5c55c5ff9d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e3535999-5c55c5ff9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e3535999: serviceaccount "payload-processing-e2e-migrate-e3535999" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e3535999-5c55c5ff9d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e3535999

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e3535999-5c55c5ff9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e3535999-bb8778658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e3535999-bb8778658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e3535999: serviceaccount "payload-processing-e2e-migrate-e3535999" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-e3535999-5c55c5ff9d-jxrqf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e3535999-bb8778658-f8p24

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-19dd11cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-19dd11cf

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-e3535999-gw-openshift-default-786745bcb-4vdgp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ait-19dd11cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b

SuccessfulCreate

Created pod: e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

openshift-ingress

multus

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-19dd11cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-19dd11cf-849f4bd677 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-19dd11cf-84b6456898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-19dd11cf-849f4bd677

FailedCreate

Error creating: pods "payload-processing-e2e-ait-19dd11cf-849f4bd677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-19dd11cf: serviceaccount "payload-processing-e2e-ait-19dd11cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-19dd11cf-849f4bd677

SuccessfulCreate

Created pod: payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-19dd11cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-19dd11cf-84b6456898 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-19dd11cf-84b6456898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-19dd11cf-84b6456898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-19dd11cf: serviceaccount "payload-processing-e2e-ait-19dd11cf" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19dd11cf-84b6456898-zfxm2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-19dd11cf-849f4bd677-brwff

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-derive-d0f5a035-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-d0f5a035-openshift-default-75fc8c6448 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-d0f5a035

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-d0f5a035

openshift-ingress

replicaset-controller

e2e-derive-d0f5a035-openshift-default-75fc8c6448

SuccessfulCreate

Created pod: e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

openshift-ingress

kubelet

e2e-ait-19dd11cf-openshift-default-6bd7b4bb6b-f5ch9

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d0f5a035: serviceaccount "payload-processing-e2e-derive-d0f5a035" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d0f5a035-559b69fcd5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-d0f5a035-559b69fcd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d0f5a035: serviceaccount "payload-processing-e2e-derive-d0f5a035" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-d0f5a035

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-d0f5a035-559b69fcd5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d0f5a035-559b69fcd5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-d0f5a035

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s

openshift-ingress

multus

payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-d0f5a035

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-d0f5a035: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-d0f5a035": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-d0f5a035, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d8c91c1e-b42c-458d-b0fd-74e5615ef17f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d0f5a035-54c4f7fd98-hxf8s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-d0f5a035-openshift-default-75fc8c6448-xrwcf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a24d8b-c6b7f8794-vbw9v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a24d8b-7bff5d6c55-2srl7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-a24d8b-openshift-default-84f4678f84-5fvhm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-7087d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7087d2

openshift-ingress

deployment-controller

e2e-explicit-7087d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7087d2-openshift-default-778677f888 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-7087d2-openshift-default-778677f888

SuccessfulCreate

Created pod: e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

openshift-ingress

multus

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7087d2-6b96655df7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7087d2-6b96655df7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7087d2: serviceaccount "payload-processing-e2e-explicit-7087d2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7087d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7087d2-6b96655df7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7087d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7087d2-56955d78fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7087d2-56955d78fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7087d2-56955d78fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7087d2: serviceaccount "payload-processing-e2e-explicit-7087d2" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7087d2-6b96655df7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7087d2-56955d78fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-e937b400

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e937b400

openshift-ingress

replicaset-controller

e2e-mt-e937b400-openshift-default-744c594c48

SuccessfulCreate

Created pod: e2e-mt-e937b400-openshift-default-744c594c48-x8n49

openshift-ingress

deployment-controller

e2e-mt-e937b400-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e937b400-openshift-default-744c594c48 from 0 to 1

openshift-ingress

multus

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e937b400-748585c95d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e937b400-748585c95d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e937b400: serviceaccount "payload-processing-e2e-mt-e937b400" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e937b400-c4879cc9c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e937b400-c4879cc9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e937b400: serviceaccount "payload-processing-e2e-mt-e937b400" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e937b400

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e937b400-748585c95d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e937b400-748585c95d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e937b400-c4879cc9c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e937b400

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e937b400-c4879cc9c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e937b400-748585c95d-9mwr6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e937b400-c4879cc9c-z9tnh

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-e937b400

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-e937b400: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-e937b400": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-e937b400, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3264c3e2-0c32-4381-acc2-704c440f638b, UID in object meta:

openshift-ingress

kubelet

e2e-mt-e937b400-openshift-default-744c594c48-x8n49

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574

SuccessfulCreate

Created pod: e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

openshift-ingress

multus

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-863d9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-863d9d-openshift-default-778fbc7574 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-863d9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-863d9d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-863d9d-7b95757497

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-863d9d-7b95757497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d: serviceaccount "payload-processing-e2e-shared-a-w2-863d9d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-863d9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-863d9d-7b95757497 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d: serviceaccount "payload-processing-e2e-shared-a-w2-863d9d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-863d9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7087d2-56955d78fd-lml8c

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-863d9d-7b95757497

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7087d2-6b96655df7-5ktj8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-7087d2-openshift-default-778677f888-cdk2v

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-b159da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-b159da

openshift-ingress

replicaset-controller

e2e-noten-b159da-openshift-default-788696c96

SuccessfulCreate

Created pod: e2e-noten-b159da-openshift-default-788696c96-2mmrv

openshift-ingress

deployment-controller

e2e-noten-b159da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-b159da-openshift-default-788696c96 from 0 to 1

openshift-ingress

kubelet

e2e-noten-b159da-openshift-default-788696c96-2mmrv

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-b159da-openshift-default-788696c96-2mmrv

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-b159da-openshift-default-788696c96-2mmrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-b159da-openshift-default-788696c96-2mmrv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-w2-e5926f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-e5926f-openshift-default-db84df5cd from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd

SuccessfulCreate

Created pod: e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-e5926f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-e5926f

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-e5926f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-e5926f-7bcd585465 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-e5926f: serviceaccount "payload-processing-e2e-shared-b-w2-e5926f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-e5926f: serviceaccount "payload-processing-e2e-shared-b-w2-e5926f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-e5926f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-586bab-89b68857c-jtc45

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-89d6bf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-89d6bf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-89d6bf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-89d6bf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 65a31dcf-ecbf-447e-8a09-e010848f6a06, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-89d6bf-85cfbc9694-fpzc9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-89d6bf-75678b5cdf-6svp2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-524adf28-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-524adf28-openshift-default-5dc9bd959b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-524adf28-openshift-default-5dc9bd959b

SuccessfulCreate

Created pod: e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

openshift-ingress

gateway_labeler_controller

e2e-mt-524adf28

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-524adf28

openshift-ingress

multus

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-89d6bf-openshift-default-65d86845db-mj888

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-1ef95c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-1ef95c

openshift-ingress

deployment-controller

e2e-shared-a-w3-1ef95c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998

SuccessfulCreate

Created pod: e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

openshift-ingress

multus

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-524adf28-79c5d568d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-524adf28-57ff794f57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-524adf28-57ff794f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-524adf28: serviceaccount "payload-processing-e2e-mt-524adf28" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-524adf28

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-524adf28-57ff794f57 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-524adf28-79c5d568d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-524adf28-79c5d568d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-524adf28: serviceaccount "payload-processing-e2e-mt-524adf28" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-524adf28-57ff794f57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-524adf28

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-524adf28-79c5d568d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1ef95c: serviceaccount "payload-processing-e2e-shared-a-w3-1ef95c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-1ef95c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-1ef95c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1ef95c: serviceaccount "payload-processing-e2e-shared-a-w3-1ef95c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8

SuccessfulCreate

Created pod: e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e344f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e344f9

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-e344f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e344f9-openshift-default-6454b58d8 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w3-e344f9

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w3-e344f9-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w3-e344f9-authn-ssl" already exists
(x2)

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e344f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e344f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e344f9: serviceaccount "payload-processing-e2e-shared-b-w3-e344f9" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e344f9: serviceaccount "payload-processing-e2e-shared-b-w3-e344f9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-b159da-openshift-default-788696c96-2mmrv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-b159da-openshift-default-788696c96-2mmrv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-b159da-openshift-default-788696c96-2mmrv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-490797-7b949f5899-6pm4b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-490797-7c9447cf5d-gb8wg

Unhealthy

Readiness probe failed: dial tcp 10.132.0.49:9004: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-490797-openshift-default-7648768bbd-rcsxs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-524adf28-79c5d568d6-cc4ws

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-524adf28-57ff794f57-hk4zf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-f0722f-openshift-default-764cbc85fd

SuccessfulCreate

Created pod: e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

openshift-ingress

deployment-controller

e2e-api-a-f0722f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f0722f-openshift-default-764cbc85fd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-f0722f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f0722f

openshift-ingress

multus

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f0722f-57df84c966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f0722f-57b85b59f7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f0722f-57b85b59f7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f0722f-57b85b59f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f0722f: serviceaccount "payload-processing-e2e-api-a-f0722f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f0722f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f0722f-57df84c966 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f0722f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f0722f-57b85b59f7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f0722f-57df84c966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f0722f-57df84c966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f0722f: serviceaccount "payload-processing-e2e-api-a-f0722f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-b-94f3e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-94f3e1

openshift-ingress

replicaset-controller

e2e-api-b-94f3e1-openshift-default-5945d49bfd

SuccessfulCreate

Created pod: e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

openshift-ingress

deployment-controller

e2e-api-b-94f3e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-94f3e1-openshift-default-5945d49bfd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-94f3e1: serviceaccount "payload-processing-e2e-api-b-94f3e1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-94f3e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-94f3e1-667bc66ccc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-94f3e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-94f3e1-667bc66ccc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-94f3e1-667bc66ccc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-94f3e1-667bc66ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-94f3e1: serviceaccount "payload-processing-e2e-api-b-94f3e1" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-f0722f-57b85b59f7-2j54q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f0722f-57df84c966-jqqj2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-94f3e1-667bc66ccc-8cbjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-863d9d-6cd8dbcc58-dv4vh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e5926f-7bcd585465-ms5wx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-7d0256-openshift-default-56f54765dd-m7wlz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e5926f-68b6695bbb-cdq2j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-e5926f-openshift-default-db84df5cd-l9lmn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6

SuccessfulCreate

Created pod: e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a17de2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a17de2

openshift-ingress

deployment-controller

e2e-ipp-a-a17de2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a17de2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a17de2-669fc94f85 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a17de2: serviceaccount "payload-processing-e2e-ipp-a-a17de2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a17de2-669fc94f85

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a17de2-669fc94f85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a17de2: serviceaccount "payload-processing-e2e-ipp-a-a17de2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a17de2-669fc94f85

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a17de2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8d2eac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8d2eac

openshift-ingress

replicaset-controller

e2e-ipp-b-8d2eac-openshift-default-5f64964966

SuccessfulCreate

Created pod: e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

openshift-ingress

deployment-controller

e2e-ipp-b-8d2eac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8d2eac-openshift-default-5f64964966 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8d2eac: serviceaccount "payload-processing-e2e-ipp-b-8d2eac" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8d2eac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8d2eac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8d2eac: serviceaccount "payload-processing-e2e-ipp-b-8d2eac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s

openshift-ingress

multus

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

Unhealthy

Readiness probe failed: Get "http://10.132.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

ProbeError

Readiness probe error: Get "http://10.132.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d20caf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d20caf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d20caf

openshift-ingress

multus

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d20caf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d20caf: serviceaccount "payload-processing-e2e-ipp-cleanup-d20caf" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d20caf: serviceaccount "payload-processing-e2e-ipp-cleanup-d20caf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d20caf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d20caf-745b94bf5-f5hrb

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-d20caf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-d20caf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4694b626-dff8-4a43-90ec-20aadc8f3c2c, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a17de2-669fc94f85-t5cql

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a17de2-54494c4c98-q8gtg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8d2eac-7c8c9987cc-d627s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8d2eac-6988b44654-frd8b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8d2eac-openshift-default-5f64964966-wvsqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1ef95c-9dd877f6f-8nkkc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e344f9-85bcc9d6c-p4xzc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e344f9-59f8ccd6f8-v9jzb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb

Killing

Stopping container istio-proxy