Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-93da06-openshift-default-545686675b-s4jt4 to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x to ip-10-0-137-192.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-c2426

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-c2426 to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-rbcpv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-rbcpv to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h to ip-10-0-139-201.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6 to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

Scheduled

Successfully assigned openshift-ingress/e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22 to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

Scheduled

Successfully assigned openshift-ingress/e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7 to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497 to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7 to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2 to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt to ip-10-0-137-192.ec2.internal

openshift-ingress

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44 to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m to ip-10-0-137-192.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-bvw27

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-bvw27 to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-autores-498d98-658857b485-ksp5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-498d98-658857b485-ksp5f to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs to ip-10-0-137-192.ec2.internal

openshift-ingress

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9 to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2 to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44 to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg to ip-10-0-137-192.ec2.internal

openshift-ingress

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-427751-openshift-default-ff96f6776-cnv5l to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567 to ip-10-0-139-201.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-8c8qv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8c8qv to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4 to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs to ip-10-0-139-201.ec2.internal

openshift-ingress

kube-auth-proxy-846c6f95fb-254hr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-846c6f95fb-254hr to ip-10-0-139-201.ec2.internal

openshift-ingress

router-default-565b697964-gmnzh

Scheduled

Successfully assigned openshift-ingress/router-default-565b697964-gmnzh to ip-10-0-137-192.ec2.internal

openshift-ingress

kube-auth-proxy-846c6f95fb-zqnpr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-846c6f95fb-zqnpr to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f to ip-10-0-137-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8 to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fc83333c-b557d67df-hrf48

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fc83333c-b557d67df-hrf48 to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-427751-58b56c8447-c5422

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-427751-58b56c8447-c5422 to ip-10-0-139-201.ec2.internal

openshift-ingress

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j to ip-10-0-139-201.ec2.internal

openshift-ingress

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m to ip-10-0-137-192.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm to ip-10-0-137-192.ec2.internal

openshift-ingress

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

Scheduled

Successfully assigned openshift-ingress/e2e-autores-498d98-openshift-default-578d9d7866-gmktw to ip-10-0-137-192.ec2.internal

openshift-ingress

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-z2s2j

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-z2s2j to ip-10-0-139-201.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-565b697964 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-565b697964

FailedCreate

Error creating: pods "router-default-565b697964-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-565b697964

FailedCreate

Error creating: pods "router-default-565b697964-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-565b697964

SuccessfulCreate

Created pod: router-default-565b697964-gmnzh
(x6)

openshift-ingress

kubelet

router-default-565b697964-gmnzh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-565b697964-gmnzh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-565b697964-gmnzh

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-565b697964-gmnzh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-565b697964-gmnzh

Created

Created container: router

openshift-ingress

kubelet

router-default-565b697964-gmnzh

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-846c6f95fb

SuccessfulCreate

Created pod: kube-auth-proxy-846c6f95fb-254hr

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-846c6f95fb from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-846c6f95fb

SuccessfulCreate

Created pod: kube-auth-proxy-846c6f95fb-zqnpr
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-846c6f95fb

FailedCreate

Error creating: pods "kube-auth-proxy-846c6f95fb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-zqnpr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-846c6f95fb-254hr

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-254hr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-8c8qv

openshift-ingress

multus

kube-auth-proxy-846c6f95fb-zqnpr

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-8c8qv

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-254hr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.628s (2.628s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-zqnpr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.65s (2.65s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-zqnpr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-zqnpr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-254hr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-846c6f95fb-254hr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8c8qv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8c8qv

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8c8qv

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8c8qv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.165s (5.165s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4vcpm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.882s (2.882s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-bvw27

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 6.935s (6.935s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc8m9m6

Killing

Stopping container istio-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-bvw27

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-bvw27

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-bvw27

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-bvw27

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-8c8qv

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8c8qv

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-c2426

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-c2426

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-rbcpv

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-z2s2j

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2s2j

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-z2s2j

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-rbcpv

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rbcpv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rbcpv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rbcpv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2s2j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.799s (1.799s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rbcpv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.831s (1.831s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2s2j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2s2j

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-c2426

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-c2426

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-c2426

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-c2426

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-c2426

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-9c9fc1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9c9fc1-openshift-default-747974446d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-9c9fc1-openshift-default-747974446d

SuccessfulCreate

Created pod: e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9c9fc1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9c9fc1

openshift-ingress

multus

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9c9fc1: serviceaccount "payload-processing-e2e-inf-a-9c9fc1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9c9fc1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9c9fc1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9c9fc1: serviceaccount "payload-processing-e2e-inf-a-9c9fc1" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-30fbcdfa-openshift-default-777f77ddb

SuccessfulCreate

Created pod: e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

openshift-ingress

deployment-controller

e2e-ait-30fbcdfa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-30fbcdfa-openshift-default-777f77ddb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-30fbcdfa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-30fbcdfa

openshift-ingress

multus

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-498d98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-498d98-openshift-default-578d9d7866 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-498d98

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-498d98

openshift-ingress

replicaset-controller

e2e-autores-498d98-openshift-default-578d9d7866

SuccessfulCreate

Created pod: e2e-autores-498d98-openshift-default-578d9d7866-gmktw

openshift-ingress

multus

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-30fbcdfa: serviceaccount "payload-processing-e2e-ait-30fbcdfa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-30fbcdfa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-30fbcdfa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-30fbcdfa-5f764dbd9c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-30fbcdfa: serviceaccount "payload-processing-e2e-ait-30fbcdfa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-498d98-566b888b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-498d98-566b888b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-498d98: serviceaccount "payload-processing-e2e-autores-498d98" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-498d98-658857b485

FailedCreate

Error creating: pods "payload-processing-e2e-autores-498d98-658857b485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-498d98: serviceaccount "payload-processing-e2e-autores-498d98" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-498d98-566b888b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-498d98

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-498d98-566b888b8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-498d98

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-498d98-658857b485 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-498d98-658857b485

SuccessfulCreate

Created pod: payload-processing-e2e-autores-498d98-658857b485-ksp5f

openshift-ingress

kubelet

payload-processing-e2e-autores-498d98-658857b485-ksp5f

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-498d98-658857b485-ksp5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-498d98-658857b485-ksp5f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-498d98-658857b485-ksp5f

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-da9534

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-da9534

openshift-ingress

deployment-controller

e2e-inf-b-da9534-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-da9534-openshift-default-64db5bf964 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-inf-b-da9534-openshift-default-64db5bf964

SuccessfulCreate

Created pod: e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

openshift-ingress

multus

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-da9534

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-da9534-bbdd7f958 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-da9534-5c58b4566c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-da9534-5c58b4566c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-da9534: serviceaccount "payload-processing-e2e-inf-b-da9534" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-da9534: serviceaccount "payload-processing-e2e-inf-b-da9534" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-da9534

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-da9534-5c58b4566c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7
(x5)

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-da9534-5c58b4566c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-30fbcdfa-openshift-default-777f77ddb-hc66c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-30fbcdfa-c747fcc9d-4t54s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-30fbcdfa-5f764dbd9c-ptgqs

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-migrate-0d4b8af1-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-0d4b8af1-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-0d4b8af1-gw

openshift-ingress

replicaset-controller

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88

SuccessfulCreate

Created pod: e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

openshift-ingress

multus

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.316s (3.316s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-0d4b8af1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0d4b8af1: serviceaccount "payload-processing-e2e-migrate-0d4b8af1" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0d4b8af1: serviceaccount "payload-processing-e2e-migrate-0d4b8af1" not found

openshift-ingress

multus

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-0d4b8af1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw
(x2)

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-0d4b8af1-8ff5d5c98-krhk9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0d4b8af1-c7cb787d-hchjw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-migrate-0d4b8af1-gw-openshift-default-7f6f5cdd88-kcp4d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ait-bd7f15a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-bd7f15a9

openshift-ingress

deployment-controller

e2e-ait-bd7f15a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-bd7f15a9-openshift-default-79749d5fb6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-bd7f15a9-openshift-default-79749d5fb6

SuccessfulCreate

Created pod: e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

openshift-ingress

multus

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h

openshift-ingress

deployment-controller

payload-processing-e2e-ait-bd7f15a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-bd7f15a9-69fd7f56c7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bd7f15a9: serviceaccount "payload-processing-e2e-ait-bd7f15a9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-bd7f15a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bd7f15a9: serviceaccount "payload-processing-e2e-ait-bd7f15a9" not found
(x2)

openshift-ingress

kubelet

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

Created

Created container: istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-498d98

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-498d98: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-498d98": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-498d98, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9992553a-7064-43e6-8fe6-fe4949b028bf, UID in object meta:
(x7)

openshift-ingress

kubelet

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

Unhealthy

Readiness probe failed: dial tcp 10.134.0.53:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-498d98-566b888b8b-b56jf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-498d98-658857b485-ksp5f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-498d98-658857b485-ksp5f

Unhealthy

Readiness probe failed: dial tcp 10.134.0.52:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-bd7f15a9-7468ccdd54-gh49h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-bd7f15a9-69fd7f56c7-gzw2j

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-bd7f15a9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-bd7f15a9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-bd7f15a9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-bd7f15a9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7328878-944a-49af-a49d-f3b183a71a9b, UID in object meta:

openshift-ingress

kubelet

e2e-ait-bd7f15a9-openshift-default-79749d5fb6-wzmgs

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-10d06905

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-10d06905

openshift-ingress

deployment-controller

e2e-derive-10d06905-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-10d06905-openshift-default-568cfcccdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-10d06905-openshift-default-568cfcccdd

SuccessfulCreate

Created pod: e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

openshift-ingress

deployment-controller

payload-processing-e2e-derive-10d06905

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-10d06905-85c56cd6df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-93da06-openshift-default-545686675b

SuccessfulCreate

Created pod: e2e-explicit-93da06-openshift-default-545686675b-s4jt4

openshift-ingress

deployment-controller

e2e-explicit-93da06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-93da06-openshift-default-545686675b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-10d06905-85c56cd6df

FailedCreate

Error creating: pods "payload-processing-e2e-derive-10d06905-85c56cd6df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-10d06905: serviceaccount "payload-processing-e2e-derive-10d06905" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-10d06905-85c56cd6df

SuccessfulCreate

Created pod: payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44

openshift-ingress

gateway_labeler_controller

e2e-explicit-93da06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-93da06

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-10d06905

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-498d98-openshift-default-578d9d7866-gmktw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-10d06905: serviceaccount "payload-processing-e2e-derive-10d06905" not found

openshift-ingress

multus

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-93da06-5b799f5fc7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-93da06-5b799f5fc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-93da06: serviceaccount "payload-processing-e2e-explicit-93da06" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-93da06-5b799f5fc7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-93da06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-93da06-5b799f5fc7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-93da06-f9c679f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-93da06-f9c679f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-93da06: serviceaccount "payload-processing-e2e-explicit-93da06" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-93da06-f9c679f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-93da06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-93da06-f9c679f9d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10d06905-5f4bcd7c78-c4jxc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-10d06905-85c56cd6df-c4n44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-10d06905-openshift-default-568cfcccdd-q7mv2

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-93da06-5b799f5fc7-vfxg7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-93da06-f9c679f9d-47x22

Killing

Stopping container payload-pre-processing

openshift-ingress

GatewayAuthBootstrap

e2e-noten-4edac4

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-noten-4edac4-authn-ssl: envoyfilters.networking.istio.io "e2e-noten-4edac4-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-noten-4edac4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-4edac4

openshift-ingress

deployment-controller

e2e-noten-4edac4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-4edac4-openshift-default-5f5487cf98 from 0 to 1

openshift-ingress

kubelet

e2e-explicit-93da06-openshift-default-545686675b-s4jt4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-4edac4-openshift-default-5f5487cf98

SuccessfulCreate

Created pod: e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9c9fc1-555c77f6db-9xfvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9c9fc1-6fcd5bbc47-5kwn2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-4edac4-openshift-default-5f5487cf98-lkqpl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-9c9fc1-openshift-default-747974446d-r4nwp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-mt-ffbdd858-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ffbdd858-openshift-default-5bfc98b9b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-da9534-5c58b4566c-sbsqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-da9534-bbdd7f958-8d2x7

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-ffbdd858

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ffbdd858

openshift-ingress

replicaset-controller

e2e-mt-ffbdd858-openshift-default-5bfc98b9b

SuccessfulCreate

Created pod: e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

openshift-ingress

multus

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ffbdd858

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ffbdd858-56b785f67c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ffbdd858: serviceaccount "payload-processing-e2e-mt-ffbdd858" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ffbdd858-56b785f67c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ffbdd858

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ffbdd858-599b557dfd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ffbdd858-56b785f67c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ffbdd858-56b785f67c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ffbdd858: serviceaccount "payload-processing-e2e-mt-ffbdd858" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d

SuccessfulCreate

Created pod: e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-932c97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-932c97

openshift-ingress

deployment-controller

e2e-shared-a-w3-932c97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-932c97-openshift-default-5bc74d985d from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-da9534-openshift-default-64db5bf964-fn54m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-932c97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-932c97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-932c97-854f8554d5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-932c97: serviceaccount "payload-processing-e2e-shared-a-w3-932c97" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-932c97-854f8554d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-932c97-854f8554d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-932c97: serviceaccount "payload-processing-e2e-shared-a-w3-932c97" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-932c97-854f8554d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": read tcp 10.133.0.2:42042->10.133.0.42:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": read tcp 10.133.0.2:42042->10.133.0.42:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-367517-openshift-default-5b6b88d848

SuccessfulCreate

Created pod: e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-367517

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-367517

openshift-ingress

deployment-controller

e2e-shared-b-w3-367517-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-367517-openshift-default-5b6b88d848 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-367517

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-367517-78dc7d5d59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-367517

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-367517: serviceaccount "payload-processing-e2e-shared-b-w3-367517" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-367517: serviceaccount "payload-processing-e2e-shared-b-w3-367517" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ffbdd858-599b557dfd-p8l9n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ffbdd858-56b785f67c-26zxx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-ffbdd858-openshift-default-5bfc98b9b-w8qmj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb

SuccessfulCreate

Created pod: e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

openshift-ingress

deployment-controller

e2e-shared-a-w2-6b9470-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-6b9470

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-6b9470

openshift-ingress

multus

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-6b9470

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-6b9470-7894c85b69 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6b9470: serviceaccount "payload-processing-e2e-shared-a-w2-6b9470" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6b9470: serviceaccount "payload-processing-e2e-shared-a-w2-6b9470" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-6b9470

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w2-01faa9-openshift-default-78d947f544

SuccessfulCreate

Created pod: e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

openshift-ingress

deployment-controller

e2e-shared-b-w2-01faa9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-01faa9-openshift-default-78d947f544 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-01faa9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-01faa9

openshift-ingress

multus

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-01faa9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-01faa9: serviceaccount "payload-processing-e2e-shared-b-w2-01faa9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-01faa9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-01faa9-55fd5674c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-01faa9: serviceaccount "payload-processing-e2e-shared-b-w2-01faa9" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-fc83333c-openshift-default-6fdd4f659b

SuccessfulCreate

Created pod: e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

openshift-ingress

deployment-controller

e2e-mt-fc83333c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fc83333c-openshift-default-6fdd4f659b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-fc83333c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fc83333c

openshift-ingress

multus

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fc83333c-b557d67df

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fc83333c-b557d67df-hrf48
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fc83333c-645678448b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fc83333c-645678448b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fc83333c: serviceaccount "payload-processing-e2e-mt-fc83333c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fc83333c-645678448b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fc83333c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fc83333c-645678448b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fc83333c-b557d67df

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fc83333c-b557d67df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fc83333c: serviceaccount "payload-processing-e2e-mt-fc83333c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fc83333c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fc83333c-b557d67df from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-fc83333c-b557d67df-hrf48

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fc83333c-b557d67df-hrf48

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-fc83333c-b557d67df-hrf48

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-fc83333c-b557d67df-hrf48

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc83333c-645678448b-btwqr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fc83333c-b557d67df-hrf48

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-fc83333c-openshift-default-6fdd4f659b-cx5wt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-427751-openshift-default-ff96f6776

SuccessfulCreate

Created pod: e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

openshift-ingress

deployment-controller

e2e-api-a-427751-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-427751-openshift-default-ff96f6776 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-427751

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-427751

openshift-ingress

multus

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-427751-58b56c8447-c5422

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-427751-f6f65fc46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-427751-58b56c8447-c5422

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-427751

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-427751-f6f65fc46 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-427751-58b56c8447-c5422

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-427751-58b56c8447

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-427751-58b56c8447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-427751: serviceaccount "payload-processing-e2e-api-a-427751" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-427751-58b56c8447

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-427751-58b56c8447-c5422

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-427751

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-427751-58b56c8447 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-427751-f6f65fc46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-427751-f6f65fc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-427751: serviceaccount "payload-processing-e2e-api-a-427751" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-427751-58b56c8447-c5422

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-1f2b49-openshift-default-84766cd698

SuccessfulCreate

Created pod: e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

openshift-ingress

deployment-controller

e2e-api-b-1f2b49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1f2b49-openshift-default-84766cd698 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-1f2b49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1f2b49

openshift-ingress

multus

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1f2b49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1f2b49-dc5dcb94f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1f2b49-dc5dcb94f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1f2b49-dc5dcb94f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1f2b49-dc5dcb94f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1f2b49: serviceaccount "payload-processing-e2e-api-b-1f2b49" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1f2b49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1f2b49: serviceaccount "payload-processing-e2e-api-b-1f2b49" not found

openshift-ingress

multus

payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.753s (1.753s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-427751-f6f65fc46-m72zb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-427751-58b56c8447-c5422

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-427751-openshift-default-ff96f6776-cnv5l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1f2b49-749dc94bfd-cz8sx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1f2b49-dc5dcb94f-v4phg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-1f2b49-openshift-default-84766cd698-7ln5f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6b9470-79b499ccbb-k9567

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6b9470-7894c85b69-55xq8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-6b9470-openshift-default-7b4dd98bdb-92z6j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-01faa9-5d9f5fb4cd-dkhgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-01faa9-55fd5674c-nc44z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-01faa9-openshift-default-78d947f544-9f94x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-e3622e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e3622e-openshift-default-7c876db644 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e3622e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e3622e

openshift-ingress

multus

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-e3622e-openshift-default-7c876db644

SuccessfulCreate

Created pod: e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e3622e: serviceaccount "payload-processing-e2e-ipp-a-e3622e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e3622e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e3622e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e3622e-579bfd5875 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e3622e-579bfd5875

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e3622e-579bfd5875

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e3622e-579bfd5875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e3622e: serviceaccount "payload-processing-e2e-ipp-a-e3622e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-68d0c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-68d0c7

openshift-ingress

replicaset-controller

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4

SuccessfulCreate

Created pod: e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

openshift-ingress

multus

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-68d0c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-68d0c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-68d0c7: serviceaccount "payload-processing-e2e-ipp-b-68d0c7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-68d0c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-68d0c7: serviceaccount "payload-processing-e2e-ipp-b-68d0c7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx
(x2)

openshift-ingress

kubelet

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-24864d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

openshift-ingress

multus

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-24864d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-24864d

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-24864d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-24864d: serviceaccount "payload-processing-e2e-ipp-cleanup-24864d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-24864d: serviceaccount "payload-processing-e2e-ipp-cleanup-24864d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-24864d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-24864d-58bb8654-28497

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-24864d-7cd4d5b9dc-572cc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-24864d-openshift-default-5dbc984b8d-lmvt4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e3622e-6fdd67f6f4-kxkbl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e3622e-579bfd5875-dqhqh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-e3622e-openshift-default-7c876db644-prslg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-68d0c7-77fcccfb5f-5mh44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-68d0c7-7d774ccc6b-q2pvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-68d0c7-openshift-default-7c4ddcfd4-t746m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-932c97-854f8554d5-69bdv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-932c97-865ccdd498-dgg5t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-932c97-openshift-default-5bc74d985d-8ccng

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-367517-78dc7d5d59-ltgcv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-367517-64f64cd6c4-59pzb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-367517-openshift-default-5b6b88d848-b867s

Killing

Stopping container istio-proxy