Time Namespace Component RelatedObject Reason Message

openshift-ingress

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-twtrf

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-twtrf to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-zzqkr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zzqkr to ip-10-0-134-241.us-west-1.compute.internal

openshift-jobset-operator

jobset-controller-manager-99c9f5865-zdltt

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-99c9f5865-zdltt to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qxlmv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7556cf8c579zksq to ip-10-0-139-174.us-west-1.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-ds2x6

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-ds2x6 to ip-10-0-139-174.us-west-1.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-bhffn

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-bhffn to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-2wf9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-2wf9z to ip-10-0-136-69.us-west-1.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47 to ip-10-0-139-174.us-west-1.compute.internal

kuadrant-system

developer-portal-controller-66d8dbb8c8-gjzk4

Scheduled

Successfully assigned kuadrant-system/developer-portal-controller-66d8dbb8c8-gjzk4 to ip-10-0-139-174.us-west-1.compute.internal

kuadrant-system

dns-operator-controller-manager-57f5c66455-kzg7s

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-57f5c66455-kzg7s to ip-10-0-139-174.us-west-1.compute.internal

kuadrant-system

kuadrant-console-plugin-7bbc6bb9d7-fh4xt

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-7bbc6bb9d7-fh4xt to ip-10-0-134-241.us-west-1.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-q29lw

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-q29lw to ip-10-0-134-241.us-west-1.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-v6wsc

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-v6wsc to ip-10-0-134-241.us-west-1.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-k2h5t

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-k2h5t to ip-10-0-136-69.us-west-1.compute.internal

kuadrant-system

limitador-limitador-77dd99c685-7pwpw

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-77dd99c685-7pwpw to ip-10-0-134-241.us-west-1.compute.internal

kuadrant-system

authorino-operator-779bff956b-x4gxj

Scheduled

Successfully assigned kuadrant-system/authorino-operator-779bff956b-x4gxj to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-th4lh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-th4lh to ip-10-0-136-69.us-west-1.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5 to ip-10-0-136-69.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-zljjn

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-6b575997cc-zljjn to ip-10-0-139-174.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7446bb48dd-sdmzv to ip-10-0-134-241.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7446bb48dd-pl9vl to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-7d877ff967-67f7z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d877ff967-67f7z to ip-10-0-134-241.us-west-1.compute.internal

kuadrant-system

authorino-f88d7cb59-zwdxz

Scheduled

Successfully assigned kuadrant-system/authorino-f88d7cb59-zwdxz to ip-10-0-136-69.us-west-1.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-xz4gm

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-xz4gm to ip-10-0-136-69.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7446bb48dd-vv55k to ip-10-0-136-69.us-west-1.compute.internal

cert-manager

cert-manager-597b95cb84-cjmvc

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-cjmvc to ip-10-0-134-241.us-west-1.compute.internal

kuadrant-system

authorino-5767bc5f74-cxc6d

Scheduled

Successfully assigned kuadrant-system/authorino-5767bc5f74-cxc6d to ip-10-0-136-69.us-west-1.compute.internal

opendatahub

ai-gateway-controller-977cb8b98-2g9x8

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-977cb8b98-2g9x8 to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

router-default-7c4dcd98c-hvk8b

Scheduled

Successfully assigned openshift-ingress/router-default-7c4dcd98c-hvk8b to ip-10-0-139-174.us-west-1.compute.internal

kuadrant-system

limitador-limitador-f7d6b5c7c-k888f

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-f7d6b5c7c-k888f to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

router-default-7c4dcd98c-hvk8b

FailedScheduling

no nodes available to schedule pods

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5 to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-dtq86

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-dtq86 to ip-10-0-136-69.us-west-1.compute.internal

kuadrant-system

authorino-74ccc46849-prr97

Scheduled

Successfully assigned kuadrant-system/authorino-74ccc46849-prr97 to ip-10-0-139-174.us-west-1.compute.internal

kuadrant-system

limitador-operator-controller-manager-68669df9c4-blk7r

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-68669df9c4-blk7r to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-ls8fr

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-ls8fr to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

maas-controller-76d5f689b5-4hdns

Scheduled

Successfully assigned opendatahub/maas-controller-76d5f689b5-4hdns to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

maas-controller-68f669d57f-tpqgx

Scheduled

Successfully assigned opendatahub/maas-controller-68f669d57f-tpqgx to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

model-serving-api-75bd89fdfc-dgdph

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-dgdph to ip-10-0-134-241.us-west-1.compute.internal

opendatahub

odh-model-controller-769875db56-grfxb

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-grfxb to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-5vv5s

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-5vv5s to ip-10-0-136-69.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-xd644

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-xd644 to ip-10-0-134-241.us-west-1.compute.internal

kuadrant-system

authorino-7597569d74-gn6xc

Scheduled

Successfully assigned kuadrant-system/authorino-7597569d74-gn6xc to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-jmftm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jmftm to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-f76ph

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-f76ph to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-swcp2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-swcp2 to ip-10-0-139-174.us-west-1.compute.internal

kuadrant-system

mcp-gateway-controller-6c98b995c5-gpvwv

Scheduled

Successfully assigned kuadrant-system/mcp-gateway-controller-6c98b995c5-gpvwv to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-zpjq2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zpjq2 to ip-10-0-139-174.us-west-1.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-7j8zc

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-7j8zc to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-zxcfg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zxcfg to ip-10-0-136-69.us-west-1.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68 to ip-10-0-136-69.us-west-1.compute.internal

kuadrant-system

authorino-76f6d65497-4tdfx

Scheduled

Successfully assigned kuadrant-system/authorino-76f6d65497-4tdfx to ip-10-0-136-69.us-west-1.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-l2r6k

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-l2r6k to ip-10-0-134-241.us-west-1.compute.internal

kuadrant-system

authorino-dc8775675-8gwc9

Scheduled

Successfully assigned kuadrant-system/authorino-dc8775675-8gwc9 to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-9stkc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-9stkc to ip-10-0-139-174.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-ll65n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-ll65n to ip-10-0-134-241.us-west-1.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-tppfb to ip-10-0-134-241.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-rszk7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-rszk7 to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

router-default-7c4dcd98c-hvk8b

FailedScheduling

no nodes available to schedule pods

openshift-ingress

kube-auth-proxy-7d877ff967-8xtlc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d877ff967-8xtlc to ip-10-0-136-69.us-west-1.compute.internal

kuadrant-system

authorino-7f84858fbd-hd7p8

Scheduled

Successfully assigned kuadrant-system/authorino-7f84858fbd-hd7p8 to ip-10-0-136-69.us-west-1.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-9j4sn

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-9j4sn to ip-10-0-136-69.us-west-1.compute.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7c4dcd98c from 0 to 1

openshift-ingress

replicaset-controller

router-default-7c4dcd98c

SuccessfulCreate

Created pod: router-default-7c4dcd98c-hvk8b
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-7c4dcd98c-hvk8b

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

Started

Container started

openshift-ingress

kubelet

router-default-7c4dcd98c-hvk8b

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-rszk7

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-rszk7

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.457s (4.457s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-5579cb49c9

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 0 to 1

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-5579cb49c9 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-9stkc

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-9stkc

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.927s (6.927s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.195s (7.195s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-kh64b

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsUnknown

requirements not yet checked
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-6b575997cc

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-6b575997cc-zljjn

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-6b575997cc from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

kuadrant-operator-controller-manager-6b575997cc-zljjn

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zljjn

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299"

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1
(x7)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-v6wsc

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-v6wsc

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-v6wsc

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7446bb48dd

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7446bb48dd-vv55k

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-7446bb48dd from 0 to 3

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7446bb48dd

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7446bb48dd-sdmzv

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7446bb48dd

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7446bb48dd-pl9vl

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7446bb48dd-vv55k

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-v6wsc

Created

Container created

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-v6wsc

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.555s (4.555s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-v6wsc

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zljjn

Created

Container created

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-q29lw

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zljjn

Started

Container started

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-bhffn

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zljjn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299" in 15.161s (15.161s including waiting). Image size: 481302115 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-bhffn

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-bhffn

Created

Container created

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-bhffn

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-bhffn

Started

Container started

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-q29lw

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-q29lw

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.545s (3.545s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.478s (3.478s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.127s (4.127s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-zljjn_645f2a5f-fa72-4bf2-a7a1-789c5da5fe5b

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-6b575997cc-zljjn_645f2a5f-fa72-4bf2-a7a1-789c5da5fe5b became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-597b95cb84-cjmvc

Created

Container created

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-cjmvc

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 857ms (857ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 837ms (837ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-cjmvc

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-vv55k

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-sdmzv

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-cjmvc

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-cjmvc

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-q29lw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-q29lw

Started

Container started

kuadrant-system

replicaset-controller

dns-operator-controller-manager-57f5c66455

SuccessfulCreate

Created pod: dns-operator-controller-manager-57f5c66455-kzg7s

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-57f5c66455 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7446bb48dd-pl9vl

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 782ms (782ms including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-q29lw

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.708s (3.709s including waiting). Image size: 224874686 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-7446bb48dd-sdmzv_214f5543-de1e-48b4-9b4e-7121984dca6e

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-7446bb48dd-sdmzv_214f5543-de1e-48b4-9b4e-7121984dca6e became leader

kuadrant-system

multus

mcp-gateway-controller-6c98b995c5-gpvwv

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-kzg7s

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388"

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-gpvwv

Pulling

Pulling image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa"

kuadrant-system

replicaset-controller

mcp-gateway-controller-6c98b995c5

SuccessfulCreate

Created pod: mcp-gateway-controller-6c98b995c5-gpvwv

kuadrant-system

deployment-controller

mcp-gateway-controller

ScalingReplicaSet

Scaled up replica set mcp-gateway-controller-6c98b995c5 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-q29lw_a4113003-043b-4753-a06f-5dbe85d5db82 became leader

kuadrant-system

multus

dns-operator-controller-manager-57f5c66455-kzg7s

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-68669df9c4

SuccessfulCreate

Created pod: limitador-operator-controller-manager-68669df9c4-blk7r

kuadrant-system

multus

authorino-operator-779bff956b-x4gxj

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-68669df9c4 from 0 to 1

kuadrant-system

kubelet

authorino-operator-779bff956b-x4gxj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402"

kuadrant-system

replicaset-controller

authorino-operator-779bff956b

SuccessfulCreate

Created pod: authorino-operator-779bff956b-x4gxj

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-779bff956b from 0 to 1

kuadrant-system

replicaset-controller

developer-portal-controller-66d8dbb8c8

SuccessfulCreate

Created pod: developer-portal-controller-66d8dbb8c8-gjzk4

kuadrant-system

deployment-controller

developer-portal-controller

ScalingReplicaSet

Scaled up replica set developer-portal-controller-66d8dbb8c8 from 0 to 1

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-blk7r

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3"

kuadrant-system

multus

limitador-operator-controller-manager-68669df9c4-blk7r

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-gjzk4

Pulling

Pulling image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90"

kuadrant-system

multus

developer-portal-controller-66d8dbb8c8-gjzk4

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-console-plugin-7bbc6bb9d7

SuccessfulCreate

Created pod: kuadrant-console-plugin-7bbc6bb9d7-fh4xt

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-kzg7s

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388" in 3.909s (3.909s including waiting). Image size: 192755988 bytes.

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-7bbc6bb9d7 from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-kzg7s

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-kzg7s

Created

Container created

kuadrant-system

kubelet

authorino-operator-779bff956b-x4gxj

Started

Container started

kuadrant-system

dns-operator-controller-manager-57f5c66455-kzg7s_0fcc81e9-1eba-42af-adee-650f9ba70de8

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-57f5c66455-kzg7s_0fcc81e9-1eba-42af-adee-650f9ba70de8 became leader

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-fh4xt

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b"

kuadrant-system

kubelet

authorino-operator-779bff956b-x4gxj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402" in 3.119s (3.119s including waiting). Image size: 167835888 bytes.

kuadrant-system

multus

kuadrant-console-plugin-7bbc6bb9d7-fh4xt

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

authorino-operator-779bff956b-x4gxj_ce618408-a787-4bef-b08b-5fe5df12b08c

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-779bff956b-x4gxj_ce618408-a787-4bef-b08b-5fe5df12b08c became leader

kuadrant-system

kubelet

authorino-operator-779bff956b-x4gxj

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-gjzk4

Started

Container started

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-gjzk4

Created

Container created

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-gpvwv

Started

Container started

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-gpvwv

Created

Container created

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-gpvwv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa" in 5.178s (5.178s including waiting). Image size: 158458620 bytes.

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-gjzk4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90" in 3.325s (3.325s including waiting). Image size: 190254564 bytes.

kuadrant-system

developer-portal-controller-66d8dbb8c8-gjzk4_34d9308b-5085-44eb-a3a7-c6742fcf2d30

6dd6d79d.kuadrant.io

LeaderElection

developer-portal-controller-66d8dbb8c8-gjzk4_34d9308b-5085-44eb-a3a7-c6742fcf2d30 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-blk7r

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-blk7r

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3" in 5.673s (5.674s including waiting). Image size: 178063410 bytes.

kuadrant-system

limitador-operator-controller-manager-68669df9c4-blk7r_29394479-6207-464b-a425-44fd2b221edf

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-68669df9c4-blk7r_29394479-6207-464b-a425-44fd2b221edf became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-blk7r

Created

Container created

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-fh4xt

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-fh4xt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b" in 14.487s (14.487s including waiting). Image size: 120696640 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-fh4xt

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7556cf8c57 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

multus

kube-auth-proxy-7d877ff967-8xtlc

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7d877ff967-67f7z

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d877ff967 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7d877ff967

SuccessfulCreate

Created pod: kube-auth-proxy-7d877ff967-67f7z

openshift-ingress

replicaset-controller

kube-auth-proxy-7d877ff967

SuccessfulCreate

Created pod: kube-auth-proxy-7d877ff967-8xtlc

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7556cf8c57

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7556cf8c579zksq

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7556cf8c579zksq

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.821s (2.821s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.804s (2.804s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-67f7z

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7d877ff967-8xtlc

Started

Container started

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulCreate

Created pod: limitador-limitador-77dd99c685-7pwpw

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-77dd99c685 from 0 to 1

kuadrant-system

multus

limitador-limitador-77dd99c685-7pwpw

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-77dd99c685-7pwpw

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-74ccc46849 from 0 to 1

kuadrant-system

multus

authorino-74ccc46849-prr97

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulCreate

Created pod: authorino-74ccc46849-prr97

kuadrant-system

kubelet

authorino-74ccc46849-prr97

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

replicaset-controller

limitador-limitador-f7d6b5c7c

SuccessfulCreate

Created pod: limitador-limitador-f7d6b5c7c-k888f

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-f7d6b5c7c from 0 to 1

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulCreate

Created pod: authorino-dc8775675-8gwc9

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-dc8775675 from 0 to 1

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-7769p"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

kuadrant-system

multus

authorino-dc8775675-8gwc9

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-dc8775675-8gwc9

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

kuadrant-system

multus

limitador-limitador-f7d6b5c7c-k888f

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-k888f

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-ghz7f"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-ls8fr

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-k888f

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 3.178s (3.178s including waiting). Image size: 134933837 bytes.

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-k888f

Created

Container created

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-k888f

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-99c9f5865

SuccessfulCreate

Created pod: jobset-controller-manager-99c9f5865-zdltt

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-99c9f5865 from 0 to 1

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls8fr

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-ls8fr

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-74ccc46849-prr97

Started

Container started

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulDelete

Deleted pod: authorino-74ccc46849-prr97

kuadrant-system

kubelet

authorino-dc8775675-8gwc9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 4.087s (4.087s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-74ccc46849-prr97

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

kuadrant-system

kubelet

authorino-dc8775675-8gwc9

Created

Container created

kuadrant-system

kubelet

authorino-74ccc46849-prr97

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 6.318s (6.318s including waiting). Image size: 208640811 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-99c9f5865-zdltt

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-99c9f5865-zdltt

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-dc8775675-8gwc9

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-74ccc46849 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-77dd99c685-7pwpw

Started

Container started

kuadrant-system

kubelet

limitador-limitador-77dd99c685-7pwpw

Created

Container created

kuadrant-system

kubelet

limitador-limitador-77dd99c685-7pwpw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 7.683s (7.683s including waiting). Image size: 134933837 bytes.

kuadrant-system

kubelet

authorino-74ccc46849-prr97

Killing

Stopping container authorino

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls8fr

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls8fr

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls8fr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.804s (2.804s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

kubelet

jobset-controller-manager-99c9f5865-zdltt

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 5.255s (5.255s including waiting). Image size: 182184678 bytes.

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulDelete

Deleted pod: limitador-limitador-77dd99c685-7pwpw

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-77dd99c685 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-77dd99c685-7pwpw

Killing

Stopping container limitador
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-ls8fr_a4360f9c-0aec-4259-b864-8e62e6e239b0

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-ls8fr_a4360f9c-0aec-4259-b864-8e62e6e239b0 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-99c9f5865-zdltt

BackOff

Back-off restarting failed container manager in pod jobset-controller-manager-99c9f5865-zdltt_openshift-jobset-operator(c1d00264-cccc-4343-88f5-59a4f456aef9)
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-99c9f5865-zdltt

Pulled

Container image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" already present on machine and can be accessed by the pod
(x3)

openshift-jobset-operator

kubelet

jobset-controller-manager-99c9f5865-zdltt

Created

Container created
(x3)

openshift-jobset-operator

kubelet

jobset-controller-manager-99c9f5865-zdltt

Started

Container started

opendatahub

replicaset-controller

maas-controller-68f669d57f

SuccessfulCreate

Created pod: maas-controller-68f669d57f-tpqgx

opendatahub

kubelet

maas-controller-76d5f689b5-4hdns

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:408b03053424161404f5c193df87a895a64bc0e5734ad40c6f8acc81c3c1023f"

openshift-jobset-operator

jobset-controller-manager-99c9f5865-zdltt_60c52205-5ef8-49d2-9d51-98eeee143edd

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-99c9f5865-zdltt_60c52205-5ef8-49d2-9d51-98eeee143edd became leader

opendatahub

replicaset-controller

maas-controller-76d5f689b5

SuccessfulCreate

Created pod: maas-controller-76d5f689b5-4hdns

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-68f669d57f from 0 to 1

opendatahub

multus

maas-controller-76d5f689b5-4hdns

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-76d5f689b5 from 0 to 1

opendatahub

kubelet

maas-controller-68f669d57f-tpqgx

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:408b03053424161404f5c193df87a895a64bc0e5734ad40c6f8acc81c3c1023f"

opendatahub

multus

maas-controller-68f669d57f-tpqgx

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-76d5f689b5-4hdns

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:408b03053424161404f5c193df87a895a64bc0e5734ad40c6f8acc81c3c1023f" in 6.328s (6.328s including waiting). Image size: 200094741 bytes.

opendatahub

kubelet

maas-controller-76d5f689b5-4hdns

Started

Container started

opendatahub

kubelet

maas-controller-76d5f689b5-4hdns

Created

Container created

opendatahub

kubelet

maas-controller-68f669d57f-tpqgx

Started

Container started

opendatahub

kubelet

maas-controller-68f669d57f-tpqgx

Created

Container created

opendatahub

kubelet

maas-controller-68f669d57f-tpqgx

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:408b03053424161404f5c193df87a895a64bc0e5734ad40c6f8acc81c3c1023f" in 5.593s (5.593s including waiting). Image size: 200094741 bytes.

opendatahub

maas-controller-68f669d57f-tpqgx_be88d271-f10b-46b5-9ff6-46f5a4455475

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-68f669d57f-tpqgx_be88d271-f10b-46b5-9ff6-46f5a4455475 became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-tppfb

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-qxlmv

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

opendatahub

replicaset-controller

maas-controller-76d5f689b5

SuccessfulDelete

Deleted pod: maas-controller-76d5f689b5-4hdns

opendatahub

kubelet

maas-controller-76d5f689b5-4hdns

Killing

Stopping container manager

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-76d5f689b5 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qxlmv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.589s (3.589s including waiting). Image size: 185476477 bytes.

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-l2r6k

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-dgdph

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-xd644

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

odh-model-controller-769875db56-grfxb

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xd644

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-rszk7

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-rszk7

opendatahub

multus

kserve-controller-manager-776cc66d47-l2r6k

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-l2r6k

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

odh-model-controller-769875db56-grfxb

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

model-serving-api-75bd89fdfc-dgdph

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-dgdph

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-xd644

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-grfxb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 17.097s (17.097s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-l2r6k

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-l2r6k

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-l2r6k

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.388s (3.388s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xd644

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.138s (4.138s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-tppfb

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-dgdph

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-dgdph

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-dgdph

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.429s (3.429s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xd644

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xd644

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-grfxb

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-grfxb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.25s (4.25s including waiting). Image size: 236755567 bytes.

opendatahub

kserve-controller-manager-776cc66d47-l2r6k_43d601d6-2879-43f1-925e-ed3d704e8210

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-l2r6k_43d601d6-2879-43f1-925e-ed3d704e8210 became leader

opendatahub

kubelet

odh-model-controller-769875db56-grfxb

Started

Container started

opendatahub

odh-model-controller-769875db56-grfxb_21ad1ab0-0da0-4223-b676-35e8199fa875

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-grfxb_21ad1ab0-0da0-4223-b676-35e8199fa875 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-xd644_461ee7a3-e424-46e1-9c44-40527ece0c45

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-xd644_461ee7a3-e424-46e1-9c44-40527ece0c45 became leader
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Created

Container created

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulCreate

Created pod: authorino-7597569d74-gn6xc

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulDelete

Deleted pod: authorino-7597569d74-gn6xc

kuadrant-system

replicaset-controller

authorino-7f84858fbd

SuccessfulCreate

Created pod: authorino-7f84858fbd-hd7p8

kuadrant-system

replicaset-controller

authorino-76f6d65497

SuccessfulDelete

Deleted pod: authorino-76f6d65497-4tdfx
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7597569d74 from 0 to 1

kuadrant-system

multus

authorino-7597569d74-gn6xc

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-7597569d74 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-76f6d65497 from 0 to 1

kuadrant-system

kubelet

authorino-7597569d74-gn6xc

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-76f6d65497 from 1 to 0

kuadrant-system

replicaset-controller

authorino-76f6d65497

SuccessfulCreate

Created pod: authorino-76f6d65497-4tdfx

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7f84858fbd from 0 to 1

kuadrant-system

multus

authorino-7f84858fbd-hd7p8

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-76f6d65497-4tdfx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

multus

authorino-76f6d65497-4tdfx

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-7f84858fbd-hd7p8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

authorino-7597569d74-gn6xc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 1.492s (1.492s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-76f6d65497-4tdfx

Created

Container created

kuadrant-system

kubelet

authorino-76f6d65497-4tdfx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 1.678s (1.678s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-7597569d74-gn6xc

Started

Container started

kuadrant-system

kubelet

authorino-7f84858fbd-hd7p8

Started

Container started

kuadrant-system

kubelet

authorino-7f84858fbd-hd7p8

Created

Container created

kuadrant-system

kubelet

authorino-7f84858fbd-hd7p8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 1.287s (1.287s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-76f6d65497-4tdfx

Started

Container started

kuadrant-system

kubelet

authorino-7597569d74-gn6xc

Created

Container created

kuadrant-system

kubelet

authorino-7597569d74-gn6xc

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-dc8775675-8gwc9

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-76f6d65497-4tdfx

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-dc8775675 from 1 to 0

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulDelete

Deleted pod: authorino-dc8775675-8gwc9

kuadrant-system

replicaset-controller

authorino-f88d7cb59

SuccessfulCreate

Created pod: authorino-f88d7cb59-zwdxz
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Unhealthy

Startup probe failed: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

ProbeError

Startup probe error: Get "http://10.132.0.28:15021/healthz/ready": dial tcp 10.132.0.28:15021: connect: connection refused body:

kuadrant-system

kubelet

authorino-f88d7cb59-zwdxz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

multus

authorino-f88d7cb59-zwdxz

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

authorino-f88d7cb59-zwdxz

Created

Container created

kuadrant-system

kubelet

authorino-f88d7cb59-zwdxz

Started

Container started

kuadrant-system

kubelet

authorino-f88d7cb59-zwdxz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 1.27s (1.27s including waiting). Image size: 208640811 bytes.

kuadrant-system

replicaset-controller

authorino-7f84858fbd

SuccessfulDelete

Deleted pod: authorino-7f84858fbd-hd7p8

kuadrant-system

kubelet

authorino-7f84858fbd-hd7p8

Killing

Stopping container authorino
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-twtrf

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-dtq86

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 1 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-dtq86

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-twtrf

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-twtrf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-twtrf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 813ms (813ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-twtrf

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-twtrf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.525s (4.525s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xd644

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-xd644

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-7j8zc

opendatahub

multus

ai-gateway-controller-7d85675f98-7j8zc

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7j8zc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7j8zc

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7j8zc

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7j8zc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 4.716s (4.716s including waiting). Image size: 183979434 bytes.

opendatahub

ai-gateway-controller-7d85675f98-7j8zc_f3dc17fc-5aad-4f75-a147-16ad79f03f3f

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-7j8zc_f3dc17fc-5aad-4f75-a147-16ad79f03f3f became leader

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-5vv5s

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-2wf9z

openshift-ingress

multus

payload-processing-55fbbbf9dc-5vv5s

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-2wf9z

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-ll65n

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-ll65n

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.914s (2.914s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.72s (2.72s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2wf9z

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-5vv5s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.666s (3.666s including waiting). Image size: 183555333 bytes.

opendatahub

llmisvc-controller-manager-6466c554d8-twtrf_88fdae2f-17a3-44ae-81de-38dd5e8198ee

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-twtrf_88fdae2f-17a3-44ae-81de-38dd5e8198ee became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Started

Container started

opendatahub

replicaset-controller

ai-gateway-controller-977cb8b98

SuccessfulCreate

Created pod: ai-gateway-controller-977cb8b98-2g9x8

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-977cb8b98 from 0 to 1

opendatahub

multus

ai-gateway-controller-977cb8b98-2g9x8

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-977cb8b98-2g9x8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-977cb8b98-2g9x8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 769ms (769ms including waiting). Image size: 183979434 bytes.

opendatahub

kubelet

ai-gateway-controller-977cb8b98-2g9x8

Started

Container started

opendatahub

kubelet

ai-gateway-controller-977cb8b98-2g9x8

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7j8zc

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-7j8zc

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-zxcfg

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 3 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-zxcfg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Started

Container started

opendatahub

ai-gateway-controller-977cb8b98-2g9x8_bba08638-b62c-4455-adc7-f4e14a3f7470

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-977cb8b98-2g9x8_bba08638-b62c-4455-adc7-f4e14a3f7470 became leader
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kxdh5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.395s (2.395s including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-xz4gm

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-xz4gm

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xz4gm

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xz4gm

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xz4gm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 598ms (598ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-xz4gm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-k2h5t

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-k2h5t

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-k2h5t

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-k2h5t

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-k2h5t

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-k2h5t

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 597ms (597ms including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-ds2x6

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-ds2x6

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-ds2x6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-ds2x6

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-ds2x6

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-ds2x6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.504s (1.504s including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 636ms (636ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vjjf5

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-9j4sn

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

multus

echo-simulator-kserve-64b6f8f96c-9j4sn

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9j4sn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-zzqkr

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-zpjq2

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 4 to 6

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-zzqkr

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-zpjq2

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9j4sn

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9j4sn

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-9j4sn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.796s (2.796s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 635ms (635ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-vrh47

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 590ms (590ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-mjs68

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-f76ph

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-th4lh

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-swcp2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-f76ph

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-swcp2

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-th4lh

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6f54779779-jmftm

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-jmftm

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f76ph

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

multus

authorino-5767bc5f74-cxc6d

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-5767bc5f74

SuccessfulCreate

Created pod: authorino-5767bc5f74-cxc6d

kuadrant-system

kubelet

authorino-5767bc5f74-cxc6d

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

replicaset-controller

authorino-f88d7cb59

SuccessfulDelete

Deleted pod: authorino-f88d7cb59-zwdxz

kuadrant-system

kubelet

authorino-f88d7cb59-zwdxz

Killing

Stopping container authorino
(x4)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-f88d7cb59 from 1 to 0

kuadrant-system

kubelet

authorino-5767bc5f74-cxc6d

Started

Container started

kuadrant-system

kubelet

authorino-5767bc5f74-cxc6d

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 2.003s (2.003s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-5767bc5f74-cxc6d

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-dtq86

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-zxcfg

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 10 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-th4lh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-dtq86

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-jmftm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-jmftm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-th4lh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zxcfg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zpjq2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-9stkc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 6 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ll65n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-zpjq2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-zzqkr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zzqkr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-ll65n

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-9stkc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-swcp2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-swcp2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 2 to 1