Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq to ip-10-0-130-63.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-snrjk

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-snrjk to ip-10-0-130-63.us-east-2.compute.internal

cert-manager

cert-manager-597b95cb84-8tphx

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-8tphx to ip-10-0-143-124.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-m67hj

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-m67hj to ip-10-0-130-63.us-east-2.compute.internal

ai-tenants

e2e-shared-a-main-84866b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-main-84866b: MaasTenantConfig is not available to restore revocation operands

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz to ip-10-0-143-124.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-wp87n

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-wp87n to ip-10-0-130-63.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-b2t94

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-b2t94 to ip-10-0-143-124.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n to ip-10-0-143-124.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-kg6wk

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-kg6wk to ip-10-0-143-124.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-858b8478db-j4wkq

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-858b8478db-j4wkq to ip-10-0-130-63.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-wrsbp

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-wrsbp to ip-10-0-130-63.us-east-2.compute.internal

llm

grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

Scheduled

Successfully assigned llm/grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

router-default-bc466ddff-fq6ch

Scheduled

Successfully assigned openshift-ingress/router-default-bc466ddff-fq6ch to ip-10-0-130-59.us-east-2.compute.internal

openshift-ingress

router-default-bc466ddff-fq6ch

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-bc466ddff-fq6ch

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5 to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d to ip-10-0-130-63.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-c5vk9

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-c5vk9 to ip-10-0-143-124.us-east-2.compute.internal

llm

grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw

Scheduled

Successfully assigned llm/grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw to ip-10-0-143-124.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-hktvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-hktvc to ip-10-0-130-63.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6s6wp

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-6s6wp to ip-10-0-130-63.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-fzpgg

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-fzpgg to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-csx9p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-csx9p to ip-10-0-130-63.us-east-2.compute.internal

llm

grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

Scheduled

Successfully assigned llm/grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv to ip-10-0-130-59.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-s8wnx

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-s8wnx to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg to ip-10-0-130-63.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-2bckk

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-2bckk to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-x9znl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-x9znl to ip-10-0-130-59.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-njzpl

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-njzpl to ip-10-0-130-59.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-862gk

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-862gk to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-vlld6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-vlld6 to ip-10-0-130-63.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-859887466c-ng525

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-859887466c-ng525 to ip-10-0-130-63.us-east-2.compute.internal

llm

grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9

Scheduled

Successfully assigned llm/grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9 to ip-10-0-130-63.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-c8nd7

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c8nd7 to ip-10-0-130-63.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-859887466c-jqcls

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-859887466c-jqcls to ip-10-0-143-124.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-qwgjp

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-qwgjp to ip-10-0-130-59.us-east-2.compute.internal

opendatahub

test-curl-8915-93f2a0

Scheduled

Successfully assigned opendatahub/test-curl-8915-93f2a0 to ip-10-0-130-63.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-hffv2

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-hffv2 to ip-10-0-130-59.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-859887466c-xzt9w

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-859887466c-xzt9w to ip-10-0-130-59.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-z9npr

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-z9npr to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-vdw7q to ip-10-0-143-124.us-east-2.compute.internal

opendatahub

test-curl-8915-8b55e9

Scheduled

Successfully assigned opendatahub/test-curl-8915-8b55e9 to ip-10-0-130-63.us-east-2.compute.internal

ai-tenants

e2e-shared-b-main-80c0a4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-main-80c0a4: MaasTenantConfig is not available to restore revocation operands

opendatahub

test-curl-8915-7d6817

Scheduled

Successfully assigned opendatahub/test-curl-8915-7d6817 to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-fnj8g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-fnj8g to ip-10-0-130-59.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-qcrqp

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-qcrqp to ip-10-0-130-63.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-bk5ll

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-bk5ll to ip-10-0-130-59.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-skbq4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-skbq4 to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-r9hdg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-r9hdg to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-pjmlx to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-dfn2b to ip-10-0-130-59.us-east-2.compute.internal

opendatahub

test-curl-8915-3470ee

Scheduled

Successfully assigned opendatahub/test-curl-8915-3470ee to ip-10-0-143-124.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-9szwl

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-9szwl to ip-10-0-143-124.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-nrwkz

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-nrwkz to ip-10-0-130-59.us-east-2.compute.internal

opendatahub

maas-controller-7f7bd5bff7-njwhq

Scheduled

Successfully assigned opendatahub/maas-controller-7f7bd5bff7-njwhq to ip-10-0-143-124.us-east-2.compute.internal

kuadrant-system

authorino-6b468fd77-gxqhg

Scheduled

Successfully assigned kuadrant-system/authorino-6b468fd77-gxqhg to ip-10-0-130-59.us-east-2.compute.internal

opendatahub

maas-controller-7c7fc58f4c-9hd4k

Scheduled

Successfully assigned opendatahub/maas-controller-7c7fc58f4c-9hd4k to ip-10-0-143-124.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-jslkl

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-jslkl to ip-10-0-130-59.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-bk8fw

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-bk8fw to ip-10-0-130-59.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-55zbg

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-55zbg to ip-10-0-130-63.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-z6dgf

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-z6dgf to ip-10-0-130-59.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-6mddl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-6mddl to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-55fbd65575-5cxxt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55fbd65575-5cxxt to ip-10-0-143-124.us-east-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-7thfb

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-7thfb to ip-10-0-130-63.us-east-2.compute.internal

kuadrant-system

authorino-6bc8f7c6d5-77xw6

Scheduled

Successfully assigned kuadrant-system/authorino-6bc8f7c6d5-77xw6 to ip-10-0-130-59.us-east-2.compute.internal

opendatahub

ai-gateway-controller-6c7f65bdc9-4jl9w

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6c7f65bdc9-4jl9w to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-bb66448f7-lkqcl

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-bb66448f7-lkqcl to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-xdc7v

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-xdc7v to ip-10-0-130-59.us-east-2.compute.internal

llm

grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l

Scheduled

Successfully assigned llm/grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l to ip-10-0-143-124.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-7dcb6fdfc4-qp4c9

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7dcb6fdfc4-qp4c9 to ip-10-0-143-124.us-east-2.compute.internal

llm

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

Scheduled

Successfully assigned llm/grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5 to ip-10-0-130-59.us-east-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-99cc8

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-99cc8 to ip-10-0-130-59.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8 to ip-10-0-130-63.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-7dcb6fdfc4-c4f4k

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7dcb6fdfc4-c4f4k to ip-10-0-130-59.us-east-2.compute.internal

kuadrant-system

authorino-768b6c54bb-4trw9

Scheduled

Successfully assigned kuadrant-system/authorino-768b6c54bb-4trw9 to ip-10-0-130-59.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-5fc9b

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5fc9b to ip-10-0-130-59.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-bc466ddff from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-bc466ddff

SuccessfulCreate

Created pod: router-default-bc466ddff-fq6ch
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-bc466ddff-fq6ch

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-bc466ddff-fq6ch

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-bc466ddff-fq6ch

Created

Container created

openshift-ingress

kubelet

router-default-bc466ddff-fq6ch

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-bc466ddff-fq6ch

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-bc466ddff-fq6ch

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xdc7v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-xdc7v

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-xdc7v

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xdc7v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.679s (3.679s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xdc7v

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xdc7v

Created

Container created

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-645b5cfbff

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-skbq4

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-645b5cfbff from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-skbq4

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55fbd65575 from 0 to 1

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.79s (9.79s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.598s (9.598s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-645b5cfbff-crwlg

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-862gk

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-862gk

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-862gk

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-6s6wp

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6s6wp

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-6s6wp

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6s6wp

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6s6wp

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6s6wp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.809s (1.809s including waiting). Image size: 177967631 bytes.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6s6wp_205cf837-3bbf-4e98-8753-017681b14a00

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-6s6wp_205cf837-3bbf-4e98-8753-017681b14a00 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-862gk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 6.538s (6.538s including waiting). Image size: 424244516 bytes.

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-qcrqp

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-qcrqp

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-862gk_93efff83-8d7a-476e-9a3f-54a9a1b4227d

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-862gk_93efff83-8d7a-476e-9a3f-54a9a1b4227d became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-862gk

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-862gk

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-qcrqp

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

dns-operator-controller-manager-8557cbdb84-qcrqp_f70515c3-3442-4aa4-bcd6-b87e1c8630b1

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-qcrqp_f70515c3-3442-4aa4-bcd6-b87e1c8630b1 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-qcrqp

Created

Container created

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-z9npr

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-qcrqp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.776s (1.776s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-qcrqp

Started

Container started

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-z9npr

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-b2t94

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-z9npr

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-c5vk9

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-c5vk9
(x5)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-c5vk9

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-snrjk

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-b2t94

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-b2t94

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-snrjk

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-snrjk

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-kg6wk

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-kg6wk

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-snrjk

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-snrjk

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-kg6wk

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-snrjk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.654s (1.654s including waiting). Image size: 167738465 bytes.

kuadrant-system

authorino-operator-7b7bb4bc77-snrjk_9e7ad3cf-713c-45d9-994b-53308d3008a9

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-snrjk_9e7ad3cf-713c-45d9-994b-53308d3008a9 became leader

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-c5vk9

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.056s (5.056s including waiting). Image size: 309650901 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-b2t94

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-b2t94

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-b2t94

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 4.055s (4.055s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-c5vk9

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-c5vk9

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-b2t94_5ac5afd9-a590-47f3-913e-d82a8d3a71ba became leader

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-kg6wk

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.229s (2.229s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-z9npr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.687s (6.687s including waiting). Image size: 342538866 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-kg6wk

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-kg6wk

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-z9npr

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-z9npr

Created

Container created

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-8tphx

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-597b95cb84-8tphx

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-597b95cb84-8tphx

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

cert-manager

kubelet

cert-manager-597b95cb84-8tphx

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-597b95cb84-8tphx

Started

Container started

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-859887466c

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-859887466c-xzt9w

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-859887466c

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-859887466c-jqcls

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-c8nd7

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-859887466c from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-859887466c

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-859887466c-ng525

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-c8nd7

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-859887466c-ng525

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-859887466c-jqcls

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-859887466c-xzt9w

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.968s (2.968s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.891s (2.891s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.928s (2.928s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 451ms (451ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-ng525

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-859887466c-xzt9w_3bab51e8-2dee-46cc-b60e-cbcb6bed27d8

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-859887466c-xzt9w_3bab51e8-2dee-46cc-b60e-cbcb6bed27d8 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-xzt9w

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 451ms (451ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 467ms (467ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-859887466c-jqcls

Created

Container created

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-862gk

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-862gk

Killing

Stopping container manager

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

multus

kube-auth-proxy-7dcb6fdfc4-c4f4k

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-c4f4k

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-7dcb6fdfc4-qp4c9

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-qp4c9

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

replicaset-controller

kube-auth-proxy-7dcb6fdfc4

SuccessfulCreate

Created pod: kube-auth-proxy-7dcb6fdfc4-qp4c9

openshift-ingress

replicaset-controller

kube-auth-proxy-7dcb6fdfc4

SuccessfulCreate

Created pod: kube-auth-proxy-7dcb6fdfc4-c4f4k

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7dcb6fdfc4 from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-hmwv7"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-bb66448f7 from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-bb66448f7

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-bb66448f7-lkqcl

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-bb66448f7-lkqcl

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-bb66448f7-lkqcl

Created

Container created

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-bb66448f7-lkqcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-bb66448f7-lkqcl

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-6vdpz"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-c8nd7_0c2a4592-a8de-420a-bac5-583889794531

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-c8nd7_0c2a4592-a8de-420a-bac5-583889794531 became leader

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-55zbg

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-2bckk

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-55zbg

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2bckk

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-2bckk

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-55zbg

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-s8wnx

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-858b8478db

SuccessfulCreate

Created pod: jobset-controller-manager-858b8478db-j4wkq

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-858b8478db from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-c4f4k

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-858b8478db-j4wkq

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-qp4c9

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-qp4c9

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-hffv2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-s8wnx

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-s8wnx

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-qp4c9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.427s (2.427s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

authorino-57f7f8659f-hffv2

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-hffv2

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-c4f4k

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-njzpl

openshift-ingress

kubelet

kube-auth-proxy-7dcb6fdfc4-c4f4k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.48s (2.48s including waiting). Image size: 188904677 bytes.

openshift-jobset-operator

multus

jobset-controller-manager-858b8478db-j4wkq

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-njzpl

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-njzpl

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-55zbg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.435s (2.435s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-55zbg

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-55zbg

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2bckk

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2bckk

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2bckk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.889s (2.889s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-s8wnx

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-s8wnx

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-s8wnx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.114s (2.114s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-hffv2

Started

Container started

openshift-jobset-operator

jobset-controller-manager-858b8478db-j4wkq_d9a1f38c-5df8-4332-a334-bbb1bc6bc765

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-858b8478db-j4wkq_d9a1f38c-5df8-4332-a334-bbb1bc6bc765 became leader

kuadrant-system

kubelet

authorino-57f7f8659f-hffv2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.267s (3.267s including waiting). Image size: 204096810 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-858b8478db-j4wkq

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-858b8478db-j4wkq

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-858b8478db-j4wkq

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.283s (3.283s including waiting). Image size: 182184678 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-hffv2

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-njzpl

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-njzpl

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-hffv2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-njzpl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.199s (3.199s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-hffv2

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-2bckk

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2bckk

Killing

Stopping container limitador

opendatahub

kserve-module-controller-manager-7566cf5fc8-55zbg_440ca2a3-35fc-44de-87aa-3410bf756deb

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-55zbg_440ca2a3-35fc-44de-87aa-3410bf756deb became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-9szwl

opendatahub

kubelet

odh-model-controller-769875db56-9szwl

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "odh-model-controller-metrics-tls" not found

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-jslkl

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-z6dgf

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-nrwkz

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jslkl

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-nrwkz

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-jslkl

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-5fc9b

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5fc9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

multus

kserve-controller-manager-776cc66d47-z6dgf

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5fc9b

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5fc9b

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-z6dgf

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

odh-model-controller-769875db56-9szwl

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-5fc9b

opendatahub

multus

model-serving-api-75bd89fdfc-nrwkz

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xdc7v

Killing

Stopping container discovery

opendatahub

kubelet

odh-model-controller-769875db56-9szwl

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-xdc7v

opendatahub

kubelet

model-serving-api-75bd89fdfc-nrwkz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.33s (2.33s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-nrwkz

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-nrwkz

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-9szwl

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-9szwl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.84s (2.84s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jslkl

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jslkl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.93s (2.93s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-z6dgf

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.873s (2.873s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-z6dgf

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-z6dgf

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-9szwl

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jslkl

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-z6dgf_24826eb7-d52a-44a4-8cd8-e5a8e9ef3087

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-z6dgf_24826eb7-d52a-44a4-8cd8-e5a8e9ef3087 became leader

opendatahub

odh-model-controller-769875db56-9szwl_5c9dfef5-a8d8-40d2-8c76-d1ef24a587f7

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-9szwl_5c9dfef5-a8d8-40d2-8c76-d1ef24a587f7 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-jslkl_d7669414-9363-4f1b-9395-ccddd7e8f3eb

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-jslkl_d7669414-9363-4f1b-9395-ccddd7e8f3eb became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

maas-controller-7c7fc58f4c

SuccessfulCreate

Created pod: maas-controller-7c7fc58f4c-9hd4k

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7c7fc58f4c from 0 to 1

opendatahub

replicaset-controller

maas-controller-7f7bd5bff7

SuccessfulCreate

Created pod: maas-controller-7f7bd5bff7-njwhq

opendatahub

multus

maas-controller-7c7fc58f4c-9hd4k

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7f7bd5bff7 from 0 to 1

opendatahub

kubelet

maas-controller-7c7fc58f4c-9hd4k

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:052668cd3113d838fddfb049129aa3ffac2090804d5ae5562a68019d7e5c054d"

opendatahub

kubelet

maas-controller-7f7bd5bff7-njwhq

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:052668cd3113d838fddfb049129aa3ffac2090804d5ae5562a68019d7e5c054d"

opendatahub

multus

maas-controller-7f7bd5bff7-njwhq

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7c7fc58f4c-9hd4k

Started

Container started

opendatahub

kubelet

maas-controller-7c7fc58f4c-9hd4k

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:052668cd3113d838fddfb049129aa3ffac2090804d5ae5562a68019d7e5c054d" in 3.199s (3.199s including waiting). Image size: 200094737 bytes.

opendatahub

kubelet

maas-controller-7f7bd5bff7-njwhq

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:052668cd3113d838fddfb049129aa3ffac2090804d5ae5562a68019d7e5c054d" in 2.889s (2.889s including waiting). Image size: 200094737 bytes.

opendatahub

kubelet

maas-controller-7f7bd5bff7-njwhq

Created

Container created

opendatahub

kubelet

maas-controller-7f7bd5bff7-njwhq

Started

Container started

opendatahub

kubelet

maas-controller-7c7fc58f4c-9hd4k

Created

Container created

opendatahub

maas-controller-7c7fc58f4c-9hd4k_69614062-a9ef-48c1-bec6-70f7e4ca8d63

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7c7fc58f4c-9hd4k_69614062-a9ef-48c1-bec6-70f7e4ca8d63 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-qwgjp

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qwgjp

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-qwgjp

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Created

Container created

opendatahub

kubelet

maas-controller-7c7fc58f4c-9hd4k

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7c7fc58f4c from 1 to 0

opendatahub

replicaset-controller

maas-controller-7c7fc58f4c

SuccessfulDelete

Deleted pod: maas-controller-7c7fc58f4c-9hd4k

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qwgjp

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.224s (11.224s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qwgjp

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qwgjp

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:

opendatahub

maas-controller-7f7bd5bff7-njwhq_b1d4dd4a-2570-4465-befa-ae5f36f27174

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7f7bd5bff7-njwhq_b1d4dd4a-2570-4465-befa-ae5f36f27174 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-99cc8

kuadrant-system

kubelet

authorino-6bc8f7c6d5-77xw6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-bk5ll

kuadrant-system

multus

authorino-6bc8f7c6d5-77xw6

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-bk5ll

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6bc8f7c6d5 from 0 to 1

kuadrant-system

kubelet

authorino-6889cbd8c4-bk5ll

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-99cc8
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

authorino-6bc8f7c6d5

SuccessfulCreate

Created pod: authorino-6bc8f7c6d5-77xw6

kuadrant-system

multus

authorino-6889cbd8c4-bk5ll

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-bk5ll

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.31s (2.31s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6bc8f7c6d5-77xw6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.908s (1.908s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6bc8f7c6d5-77xw6

Created

Container created

kuadrant-system

kubelet

authorino-6bc8f7c6d5-77xw6

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-bk5ll

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-bk5ll

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-6889cbd8c4-bk5ll

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-njzpl

kuadrant-system

kubelet

authorino-56c6c9ddd5-njzpl

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6b468fd77-gxqhg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6b468fd77-gxqhg

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-6b468fd77

SuccessfulCreate

Created pod: authorino-6b468fd77-gxqhg

kuadrant-system

kubelet

authorino-6b468fd77-gxqhg

Created

Container created

kuadrant-system

kubelet

authorino-6b468fd77-gxqhg

Started

Container started

kuadrant-system

kubelet

authorino-6b468fd77-gxqhg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 705ms (705ms including waiting). Image size: 204096810 bytes.

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6bc8f7c6d5

SuccessfulDelete

Deleted pod: authorino-6bc8f7c6d5-77xw6

kuadrant-system

kubelet

authorino-6bc8f7c6d5-77xw6

Killing

Stopping container authorino

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-bk8fw

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bk8fw

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bk8fw

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bk8fw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 394ms (394ms including waiting). Image size: 235100981 bytes.

opendatahub

multus

llmisvc-controller-manager-6466c554d8-bk8fw

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-bk8fw

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jslkl

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-jslkl

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-7thfb

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7thfb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-7thfb

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7thfb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.377s (2.377s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7thfb

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7thfb

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-7thfb_34f3b5f8-65ea-48fc-8779-569200b62f97

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-7thfb_34f3b5f8-65ea-48fc-8779-569200b62f97 became leader

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-hktvc

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-csx9p

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-csx9p

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-55fbbbf9dc-hktvc

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-csx9p

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hktvc

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-csx9p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-csx9p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.37s (2.37s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hktvc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.263s (2.263s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hktvc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-csx9p

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hktvc

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6c7f65bdc9 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-6c7f65bdc9

SuccessfulCreate

Created pod: ai-gateway-controller-6c7f65bdc9-4jl9w

opendatahub

kubelet

ai-gateway-controller-6c7f65bdc9-4jl9w

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-6c7f65bdc9-4jl9w

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6c7f65bdc9-4jl9w

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6c7f65bdc9-4jl9w

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6c7f65bdc9-4jl9w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 396ms (396ms including waiting). Image size: 183979433 bytes.

opendatahub

llmisvc-controller-manager-6466c554d8-bk8fw_27d67f7c-ab2d-4e68-94c6-285f7626175e

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-bk8fw_27d67f7c-ab2d-4e68-94c6-285f7626175e became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-7thfb

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7thfb

Killing

Stopping container manager

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.174s (1.174s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-qzzpb

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-wrsbp

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-wrsbp

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wrsbp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wrsbp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.319s (1.319s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-fzpgg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fzpgg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-fzpgg

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wrsbp

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-wrsbp

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fzpgg

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fzpgg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 266ms (266ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fzpgg

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-m67hj

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-m67hj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-m67hj

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-m67hj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 280ms (280ms including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-m67hj

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz

Started

Container started

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 267ms (267ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8z5plz

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-m67hj

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

opendatahub

ai-gateway-controller-6c7f65bdc9-4jl9w_4887ed7f-da19-403d-aa40-27ee4bfcc5cb

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6c7f65bdc9-4jl9w_4887ed7f-da19-403d-aa40-27ee4bfcc5cb became leader

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-wp87n

llm

multus

echo-simulator-kserve-64b6f8f96c-wp87n

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-wp87n

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 273ms (273ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

kubelet

echo-simulator-kserve-64b6f8f96c-wp87n

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 280ms (280ms including waiting). Image size: 98346788 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-wp87n

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.868s (1.868s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-n2m2n

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-7k6d8

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-wp87n

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-768b6c54bb

SuccessfulCreate

Created pod: authorino-768b6c54bb-4trw9

kuadrant-system

kubelet

authorino-768b6c54bb-4trw9

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-768b6c54bb-4trw9

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-768b6c54bb-4trw9

Started

Container started

kuadrant-system

kubelet

authorino-768b6c54bb-4trw9

Created

Container created

kuadrant-system

kubelet

authorino-768b6c54bb-4trw9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 923ms (923ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6b468fd77-gxqhg

Killing

Stopping container authorino
(x4)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-6b468fd77 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6b468fd77

SuccessfulDelete

Deleted pod: authorino-6b468fd77-gxqhg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-vdw7q

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-dfn2b

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-vlld6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55fbd65575 from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-vdw7q

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-dfn2b

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-vlld6

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.403s (3.403s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.474s (3.474s including waiting). Image size: 183555333 bytes.
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-fnj8g

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-5cxxt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55fbd65575 from 4 to 6

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-5cxxt

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-5cxxt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-5cxxt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-5cxxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-fnj8g

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-5cxxt

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-5cxxt

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.Deployment llm/grid-inv-492f3f9a-model-kserve

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.PodMonitor llm/grid-inv-492f3f9a-model-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.Secret llm/grid-inv-492f3f9a-model-kserve-self-signed-certs

llm

deployment-controller

grid-inv-492f3f9a-model-kserve

ScalingReplicaSet

Scaled up replica set grid-inv-492f3f9a-model-kserve-555886ffbd from 0 to 1

llm

replicaset-controller

grid-inv-492f3f9a-model-kserve-555886ffbd

SuccessfulCreate

Created pod: grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.Service llm/grid-inv-492f3f9a-model-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.HTTPRoute llm/grid-inv-492f3f9a-model-kserve-route

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.DestinationRule llm/grid-inv-492f3f9a-model-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.NetworkPolicy llm/grid-inv-492f3f9a-model-prometheus-scraping

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Created

Created v1.PodMonitor llm/grid-inv-492f3f9a-model-kserve-llmisvc-engine

llm

multus

grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

llm

kubelet

grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

Created

Container created

llm

kubelet

grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

Started

Container started

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.Deployment llm/grid-inv-492f3f9a-unmatched-kserve

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.DestinationRule llm/grid-inv-492f3f9a-unmatched-kserve-workload-svc

llm

deployment-controller

grid-inv-492f3f9a-unmatched-kserve

ScalingReplicaSet

Scaled up replica set grid-inv-492f3f9a-unmatched-kserve-6b8f99648b from 0 to 1

llm

multus

grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.NetworkPolicy llm/grid-inv-492f3f9a-unmatched-prometheus-scraping

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.PodMonitor llm/grid-inv-492f3f9a-unmatched-kserve-llmisvc-engine

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.PodMonitor llm/grid-inv-492f3f9a-unmatched-kserve-llmisvc-engine-default

llm

replicaset-controller

grid-inv-492f3f9a-unmatched-kserve-6b8f99648b

SuccessfulCreate

Created pod: grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.Secret llm/grid-inv-492f3f9a-unmatched-kserve-self-signed-certs

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.Service llm/grid-inv-492f3f9a-unmatched-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Created

Created v1.HTTPRoute llm/grid-inv-492f3f9a-unmatched-kserve-route

llm

kubelet

grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw

Created

Container created

llm

kubelet

grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw

Started

Container started

llm

kubelet

grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x2)

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

Updated

Updated v1.Secret llm/grid-inv-492f3f9a-model-kserve-self-signed-certs

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

Updated

Updated v1.Secret llm/grid-inv-492f3f9a-unmatched-kserve-self-signed-certs

llm

LLMInferenceServiceController

grid-inv-492f3f9a-model

LLMInferenceServiceReady

LLMInferenceService [grid-inv-492f3f9a-model] is Ready

llm

LLMInferenceServiceController

grid-inv-492f3f9a-unmatched

LLMInferenceServiceReady

LLMInferenceService [grid-inv-492f3f9a-unmatched] is Ready

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-r9hdg

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55fbd65575 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-x9znl

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55fbd65575-6mddl

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-55fbd65575-pjmlx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-pjmlx

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-r9hdg

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-6mddl

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55fbd65575-x9znl

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

Killing

Stopping container main

llm

kubelet

grid-inv-492f3f9a-unmatched-kserve-6b8f99648b-8sfxw

Killing

Stopping container main

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.DestinationRule llm/grid-inv-c9819f68-model-kserve-workload-svc

llm

deployment-controller

grid-inv-c9819f68-model-kserve

ScalingReplicaSet

Scaled up replica set grid-inv-c9819f68-model-kserve-6fd48c8ff4 from 0 to 1

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.Secret llm/grid-inv-c9819f68-model-kserve-self-signed-certs

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.HTTPRoute llm/grid-inv-c9819f68-model-kserve-route

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.Service llm/grid-inv-c9819f68-model-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.Deployment llm/grid-inv-c9819f68-model-kserve

llm

replicaset-controller

grid-inv-c9819f68-model-kserve-6fd48c8ff4

SuccessfulCreate

Created pod: grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l

llm

kubelet

grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.NetworkPolicy llm/grid-inv-c9819f68-model-prometheus-scraping

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.PodMonitor llm/grid-inv-c9819f68-model-kserve-llmisvc-engine

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Created

Created v1.PodMonitor llm/grid-inv-c9819f68-model-kserve-llmisvc-engine-default

llm

kubelet

grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l

Created

Container created

llm

kubelet

grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l

Started

Container started

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.PodMonitor llm/grid-inv-c9819f68-unmatched-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.PodMonitor llm/grid-inv-c9819f68-unmatched-kserve-llmisvc-engine

llm

replicaset-controller

grid-inv-c9819f68-unmatched-kserve-7467cc75b4

SuccessfulCreate

Created pod: grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.DestinationRule llm/grid-inv-c9819f68-unmatched-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.NetworkPolicy llm/grid-inv-c9819f68-unmatched-prometheus-scraping

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.Deployment llm/grid-inv-c9819f68-unmatched-kserve

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.Service llm/grid-inv-c9819f68-unmatched-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.HTTPRoute llm/grid-inv-c9819f68-unmatched-kserve-route

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Created

Created v1.Secret llm/grid-inv-c9819f68-unmatched-kserve-self-signed-certs

llm

deployment-controller

grid-inv-c9819f68-unmatched-kserve

ScalingReplicaSet

Scaled up replica set grid-inv-c9819f68-unmatched-kserve-7467cc75b4 from 0 to 1

llm

multus

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

Updated

Updated v1.Secret llm/grid-inv-c9819f68-model-kserve-self-signed-certs

llm

kubelet

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1"
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

Started

Container started

llm

kubelet

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" in 1.814s (1.814s including waiting). Image size: 98346788 bytes.

llm

kubelet

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

Created

Container created

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

Updated

Updated v1.Secret llm/grid-inv-c9819f68-unmatched-kserve-self-signed-certs

llm

kubelet

grid-inv-492f3f9a-model-kserve-555886ffbd-k6tsg

Unhealthy

Readiness probe failed: Get "https://10.134.0.54:8000/ready": dial tcp 10.134.0.54:8000: connect: connection refused

llm

LLMInferenceServiceController

grid-inv-c9819f68-model

LLMInferenceServiceReady

LLMInferenceService [grid-inv-c9819f68-model] is Ready

llm

LLMInferenceServiceController

grid-inv-c9819f68-unmatched

LLMInferenceServiceReady

LLMInferenceService [grid-inv-c9819f68-unmatched] is Ready

opendatahub

kubelet

test-curl-8915-7d6817

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-8915-7d6817

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-8915-7d6817

Started

Container started

opendatahub

kubelet

test-curl-8915-7d6817

Created

Container created

opendatahub

kubelet

test-curl-8915-7d6817

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.501s (2.501s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-8915-7d6817

Killing

Stopping container test-curl-8915-7d6817

opendatahub

kubelet

test-curl-8915-93f2a0

Created

Container created

opendatahub

kubelet

test-curl-8915-93f2a0

Started

Container started

opendatahub

kubelet

test-curl-8915-93f2a0

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-8915-93f2a0

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

opendatahub

multus

test-curl-8915-3470ee

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-8915-93f2a0

Killing

Stopping container test-curl-8915-93f2a0

opendatahub

kubelet

test-curl-8915-3470ee

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-8915-3470ee

Started

Container started

opendatahub

kubelet

test-curl-8915-3470ee

Created

Container created

opendatahub

kubelet

test-curl-8915-3470ee

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 893ms (893ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-8915-3470ee

Killing

Stopping container test-curl-8915-3470ee

openshift-ingress

gateway_labeler_controller

e2e-shared-a-main-84866b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-main-84866b

openshift-ingress

replicaset-controller

e2e-shared-a-main-84866b-openshift-default-c5ff85555

SuccessfulCreate

Created pod: e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

openshift-ingress

multus

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-main-84866b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-main-84866b-openshift-default-c5ff85555 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-84866b: serviceaccount "payload-processing-e2e-shared-a-main-84866b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-main-84866b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-main-84866b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-main-84866b-668c795b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-main-84866b-668c795b9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-main-84866b-668c795b9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-main-84866b-668c795b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-84866b: serviceaccount "payload-processing-e2e-shared-a-main-84866b" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-b-main-80c0a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57

SuccessfulCreate

Created pod: e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

openshift-ingress

gateway_labeler_controller

e2e-shared-b-main-80c0a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-main-80c0a4

openshift-ingress

multus

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-main-80c0a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-80c0a4: serviceaccount "payload-processing-e2e-shared-b-main-80c0a4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-main-80c0a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-80c0a4: serviceaccount "payload-processing-e2e-shared-b-main-80c0a4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-80c0a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-80c0a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": read tcp 10.133.0.2:59636->10.133.0.45:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": read tcp 10.133.0.2:59636->10.133.0.45:15021: read: connection reset by peer body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-84866b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-main-84866b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-80c0a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-main-80c0a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-8915-8b55e9

Started

Container started

opendatahub

kubelet

test-curl-8915-8b55e9

Created

Container created

opendatahub

kubelet

test-curl-8915-8b55e9

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-8915-8b55e9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-8915-8b55e9

Killing

Stopping container test-curl-8915-8b55e9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

ProbeError

Readiness probe error: Get "http://10.134.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Unhealthy

Readiness probe failed: Get "http://10.134.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

grid-inv-c9819f68-model-kserve-6fd48c8ff4-df28l

Killing

Stopping container main

llm

kubelet

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

Killing

Stopping container main

llm

deployment-controller

grid-inv-a51f6a78-model-kserve

ScalingReplicaSet

Scaled up replica set grid-inv-a51f6a78-model-kserve-67d8f7c477 from 0 to 1

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.HTTPRoute llm/grid-inv-a51f6a78-model-kserve-route

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.PodMonitor llm/grid-inv-a51f6a78-model-kserve-llmisvc-engine

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.Secret llm/grid-inv-a51f6a78-model-kserve-self-signed-certs

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.Deployment llm/grid-inv-a51f6a78-model-kserve

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.NetworkPolicy llm/grid-inv-a51f6a78-model-prometheus-scraping

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.Service llm/grid-inv-a51f6a78-model-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.PodMonitor llm/grid-inv-a51f6a78-model-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Created

Created v1.DestinationRule llm/grid-inv-a51f6a78-model-kserve-workload-svc

llm

replicaset-controller

grid-inv-a51f6a78-model-kserve-67d8f7c477

SuccessfulCreate

Created pod: grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

llm

kubelet

grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

Created

Container created

llm

multus

grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

kubelet

grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

Started

Container started

llm

kubelet

grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.Service llm/grid-inv-a51f6a78-unmatched-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.Secret llm/grid-inv-a51f6a78-unmatched-kserve-self-signed-certs

llm

deployment-controller

grid-inv-a51f6a78-unmatched-kserve

ScalingReplicaSet

Scaled up replica set grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7 from 0 to 1

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.Deployment llm/grid-inv-a51f6a78-unmatched-kserve

llm

replicaset-controller

grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7

SuccessfulCreate

Created pod: grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9

llm

multus

grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

llm

kubelet

grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9

Created

Container created

llm

kubelet

grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9

Started

Container started

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.PodMonitor llm/grid-inv-a51f6a78-unmatched-kserve-llmisvc-engine-default

llm

kubelet

grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.PodMonitor llm/grid-inv-a51f6a78-unmatched-kserve-llmisvc-engine

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.NetworkPolicy llm/grid-inv-a51f6a78-unmatched-prometheus-scraping

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.HTTPRoute llm/grid-inv-a51f6a78-unmatched-kserve-route

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Created

Created v1.DestinationRule llm/grid-inv-a51f6a78-unmatched-kserve-workload-svc

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

Updated

Updated v1.Secret llm/grid-inv-a51f6a78-model-kserve-self-signed-certs

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

Updated

Updated v1.Secret llm/grid-inv-a51f6a78-unmatched-kserve-self-signed-certs

llm

LLMInferenceServiceController

grid-inv-a51f6a78-model

LLMInferenceServiceReady

LLMInferenceService [grid-inv-a51f6a78-model] is Ready

llm

kubelet

grid-inv-c9819f68-unmatched-kserve-7467cc75b4-krfr5

Unhealthy

Readiness probe failed: Get "https://10.132.0.46:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

LLMInferenceServiceController

grid-inv-a51f6a78-unmatched

LLMInferenceServiceReady

LLMInferenceService [grid-inv-a51f6a78-unmatched] is Ready

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-c8nd7

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-c8nd7

Created

Container created
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-c8nd7

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-c8nd7_527fb0ec-713e-4a00-8610-4c9597b3b117

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-c8nd7_527fb0ec-713e-4a00-8610-4c9597b3b117 became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

Killing

Stopping container main

llm

kubelet

grid-inv-a51f6a78-unmatched-kserve-6c9995fbd7-sz8t9

Killing

Stopping container main

llm

kubelet

grid-inv-a51f6a78-model-kserve-67d8f7c477-r46sv

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": dial tcp 10.132.0.48:8000: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-main-84866b-668c795b9-76v4d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-main-84866b-f7b49c767-2rlwf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-main-84866b-openshift-default-c5ff85555-jpsdd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-main-80c0a4-openshift-default-578bc6cc57-wzzvr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-main-80c0a4-db94cb7f9-8ztl5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-main-80c0a4-5b5bf974b787bdq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55fbd65575 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-6mddl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-6mddl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vlld6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-r9hdg

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55fbd65575 from 9 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-pjmlx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-r9hdg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-vlld6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-pjmlx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-x9znl

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55fbd65575 from 6 to 2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-vdw7q

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-dfn2b

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-fnj8g

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-dfn2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-fnj8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-vdw7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-x9znl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55fbd65575 from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55fbd65575

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55fbd65575-skbq4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55fbd65575-skbq4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: