Time Namespace Component RelatedObject Reason Message

opendatahub-operator-system

opendatahub-operator-controller-manager-f946d78f-wgkmw

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-f946d78f-wgkmw to ip-10-0-129-207.us-west-1.compute.internal

openshift-ingress

router-default-5864f9dbcc-9vf2j

Scheduled

Successfully assigned openshift-ingress/router-default-5864f9dbcc-9vf2j to ip-10-0-129-207.us-west-1.compute.internal

openshift-jobset-operator

jobset-controller-manager-695dd9ff5-c6n7q

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-695dd9ff5-c6n7q to ip-10-0-129-207.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q to ip-10-0-128-219.us-west-1.compute.internal

kuadrant-system

authorino-57f7f8659f-jtm2l

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-jtm2l to ip-10-0-128-219.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-f946d78f-tmxcn

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-f946d78f-tmxcn to ip-10-0-128-219.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7lvm2

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7lvm2 to ip-10-0-128-219.us-west-1.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-vzb22

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-vzb22 to ip-10-0-138-77.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-f946d78f-84754

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-f946d78f-84754 to ip-10-0-138-77.us-west-1.compute.internal

openshift-ingress

router-default-5864f9dbcc-9vf2j

FailedScheduling

no nodes available to schedule pods

openshift-ingress

data-science-gateway-data-science-gateway-class-557c4f746fzsbh2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-557c4f746fzsbh2 to ip-10-0-128-219.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-fsvvr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-fsvvr to ip-10-0-129-207.us-west-1.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-xplzx

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-xplzx to ip-10-0-128-219.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bf6lh to ip-10-0-128-219.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-6cd4bcb5cf-kcthp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6cd4bcb5cf-kcthp to ip-10-0-138-77.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-6cd4bcb5cf-slc4r

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6cd4bcb5cf-slc4r to ip-10-0-129-207.us-west-1.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-kgp2n

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-kgp2n to ip-10-0-128-219.us-west-1.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-hmwq8

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-hmwq8 to ip-10-0-138-77.us-west-1.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-m4fgp

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-m4fgp to ip-10-0-138-77.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-746ff8f49f-plmnh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-plmnh to ip-10-0-128-219.us-west-1.compute.internal

opendatahub

odh-model-controller-769875db56-h4snm

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-h4snm to ip-10-0-138-77.us-west-1.compute.internal

openshift-ingress

router-default-5864f9dbcc-9vf2j

FailedScheduling

no nodes available to schedule pods

opendatahub

kserve-controller-manager-776cc66d47-rfztm

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-rfztm to ip-10-0-138-77.us-west-1.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-ldsqg

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-ldsqg to ip-10-0-138-77.us-west-1.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-jpxhf

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-jpxhf to ip-10-0-128-219.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-xtqsk

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-xtqsk to ip-10-0-138-77.us-west-1.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-h5xh4

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-h5xh4 to ip-10-0-128-219.us-west-1.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-9dj7s

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-9dj7s to ip-10-0-138-77.us-west-1.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-w8hjl

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-w8hjl to ip-10-0-128-219.us-west-1.compute.internal

kuadrant-system

authorino-56c6c9ddd5-l6tfj

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-l6tfj to ip-10-0-128-219.us-west-1.compute.internal

cert-manager

cert-manager-597b95cb84-56m9h

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-56m9h to ip-10-0-138-77.us-west-1.compute.internal

opendatahub

model-serving-api-75bd89fdfc-k4tr2

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-k4tr2 to ip-10-0-138-77.us-west-1.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5864f9dbcc from 0 to 1

openshift-ingress

replicaset-controller

router-default-5864f9dbcc

SuccessfulCreate

Created pod: router-default-5864f9dbcc-9vf2j

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-5864f9dbcc-9vf2j

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-5864f9dbcc-9vf2j

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-5864f9dbcc-9vf2j

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-5864f9dbcc-9vf2j

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5864f9dbcc-9vf2j

Started

Container started

openshift-ingress

kubelet

router-default-5864f9dbcc-9vf2j

Created

Container created

openshift-ingress

kubelet

router-default-5864f9dbcc-9vf2j

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-5864f9dbcc-9vf2j

AddedInterface

Add eth0 [10.133.0.13/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-fsvvr

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-fsvvr

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-fsvvr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-fsvvr

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-fsvvr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-fsvvr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.184s (3.184s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-fsvvr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-fsvvr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-564f56d49f from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-564f56d49f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-746ff8f49f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-746ff8f49f-plmnh

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-746ff8f49f from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-746ff8f49f-plmnh

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-746ff8f49f-plmnh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-746ff8f49f-plmnh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.629s (9.629s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-746ff8f49f-plmnh

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.787s (9.787s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-564f56d49f-xct5q

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-746ff8f49f-plmnh

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-f946d78f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-f946d78f-wgkmw

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-f946d78f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-f946d78f-tmxcn

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-f946d78f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-f946d78f-84754

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-f946d78f from 0 to 3

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-f946d78f-84754

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-f946d78f-tmxcn

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-f946d78f-wgkmw

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

install-97xlc

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.25s (3.25s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.153s (3.153s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.161s (3.161s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-84754

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 820ms (820ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 848ms (848ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 805ms (805ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-tmxcn

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-f946d78f-84754_b797ac9e-1992-48c2-952c-b087e28cf9dd

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-f946d78f-84754_b797ac9e-1992-48c2-952c-b087e28cf9dd became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f946d78f-wgkmw

Started

Container started

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-xplzx

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-xplzx

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xplzx

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-kgp2n
(x6)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-kgp2n

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-kgp2n

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1
(x8)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-vzb22

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-vzb22

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-vzb22

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-w8hjl

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

authorino-operator-7b7bb4bc77-w8hjl

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xplzx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 4.194s (4.194s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-xplzx_bb081b5b-5943-4dbc-a9d5-313eca938235

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-xplzx_bb081b5b-5943-4dbc-a9d5-313eca938235 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xplzx

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-w8hjl

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xplzx

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-kgp2n

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-kgp2n

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.962s (3.962s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-kgp2n

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-vzb22

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-vzb22

Created

Container created

kuadrant-system

authorino-operator-7b7bb4bc77-w8hjl_df619c82-31f3-4c76-bcca-0f5105792f2e

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-w8hjl_df619c82-31f3-4c76-bcca-0f5105792f2e became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-w8hjl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.865s (1.865s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-w8hjl

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-vzb22

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.755s (3.755s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-w8hjl

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-h5xh4

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-h5xh4

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-m4fgp

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-m4fgp

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h5xh4

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h5xh4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.97s (1.97s including waiting). Image size: 177967631 bytes.

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-56m9h

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-m4fgp

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

cert-manager

kubelet

cert-manager-597b95cb84-56m9h

Started

Container started

cert-manager

multus

cert-manager-597b95cb84-56m9h

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-56m9h

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-56m9h

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h5xh4

Created

Container created

kuadrant-system

limitador-operator-controller-manager-5778bb4449-h5xh4_2a29d4d7-b02e-40eb-b30b-15e5ecd5918a

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-h5xh4_2a29d4d7-b02e-40eb-b30b-15e5ecd5918a became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-h5xh4

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-m4fgp

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.302s (3.302s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-m4fgp

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-m4fgp

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-m4fgp_3082cebd-4449-4333-97a3-8674267351b9 became leader

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7lvm2

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7lvm2

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7lvm2

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7lvm2

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7lvm2

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7lvm2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.382s (4.382s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7lvm2_e900eb6b-d6e7-4648-996a-14d7a8971a04

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7lvm2_e900eb6b-d6e7-4648-996a-14d7a8971a04 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-hmwq8

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-hmwq8

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-hmwq8

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-hmwq8

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-hmwq8

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-hmwq8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.383s (5.383s including waiting). Image size: 342538866 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-557c4f746f from 0 to 1

openshift-ingress

replicaset-controller

kube-auth-proxy-6cd4bcb5cf

SuccessfulCreate

Created pod: kube-auth-proxy-6cd4bcb5cf-slc4r

openshift-ingress

replicaset-controller

kube-auth-proxy-6cd4bcb5cf

SuccessfulCreate

Created pod: kube-auth-proxy-6cd4bcb5cf-kcthp

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6cd4bcb5cf from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-557c4f746f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-557c4f746fzsbh2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-557c4f746fzsbh2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-557c4f746fzsbh2

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-557c4f746fzsbh2

Created

Container created

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-557c4f746fzsbh2

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6cd4bcb5cf-kcthp

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-kcthp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-slc4r

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-6cd4bcb5cf-slc4r

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-9dj7s

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-slc4r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.579s (2.579s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

limitador-limitador-74dfcfb894-9dj7s

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9dj7s

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-kcthp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.672s (2.672s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-slc4r

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-slc4r

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-kcthp

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-6cd4bcb5cf-kcthp

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-jtm2l

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-jtm2l

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-jtm2l

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-jtm2l

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-jtm2l

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9dj7s

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.076s (3.076s including waiting). Image size: 133379307 bytes.

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-l6tfj

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9dj7s

Started

Container started

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-jpxhf

kuadrant-system

kubelet

authorino-57f7f8659f-jtm2l

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.18s (2.18s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9dj7s

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

multus

authorino-56c6c9ddd5-l6tfj

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-jpxhf

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-jpxhf

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-l6tfj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-jpxhf

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-jpxhf

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-l6tfj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.215s (1.215s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-l6tfj

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-jtm2l

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-jpxhf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.628s (1.628s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-jtm2l

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-56c6c9ddd5-l6tfj

Started

Container started

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-f76nb"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-lgcfj"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-695dd9ff5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-695dd9ff5

SuccessfulCreate

Created pod: jobset-controller-manager-695dd9ff5-c6n7q

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

multus

jobset-controller-manager-695dd9ff5-c6n7q

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

kubelet

jobset-controller-manager-695dd9ff5-c6n7q

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

kubelet

jobset-controller-manager-695dd9ff5-c6n7q

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.559s (3.559s including waiting). Image size: 182184678 bytes.

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

jobset-controller-manager-695dd9ff5-c6n7q_e1adedc0-4d67-4961-8432-a2c9c4db39ee

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-695dd9ff5-c6n7q_e1adedc0-4d67-4961-8432-a2c9c4db39ee became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-695dd9ff5-c6n7q

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-695dd9ff5-c6n7q

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-9dj7s

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9dj7s

Killing

Stopping container limitador

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-ldsqg

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ldsqg

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-ldsqg

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ldsqg

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ldsqg

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ldsqg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.015s (2.015s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-ldsqg_375ab3c5-1f44-42dd-8837-f21d435e0d93

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-ldsqg_375ab3c5-1f44-42dd-8837-f21d435e0d93 became leader

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-bf6lh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.1s (3.1s including waiting). Image size: 185476477 bytes.

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-xtqsk

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bf6lh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-k4tr2

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-rfztm

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-h4snm

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-k4tr2

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-rfztm

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

model-serving-api-75bd89fdfc-k4tr2

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

odh-model-controller-769875db56-h4snm

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-h4snm

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

kserve-controller-manager-776cc66d47-rfztm

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtqsk

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-xtqsk

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-fsvvr

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-fsvvr

Killing

Stopping container discovery

opendatahub

kubelet

model-serving-api-75bd89fdfc-k4tr2

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-rfztm

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-rfztm

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.111s (3.111s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtqsk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.975s (2.976s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtqsk

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtqsk

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-rfztm

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-k4tr2

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-k4tr2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.802s (2.802s including waiting). Image size: 184925761 bytes.

opendatahub

kserve-controller-manager-776cc66d47-rfztm_ec879ffc-91f7-4664-a7f1-0e37bb2777b7

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-rfztm_ec879ffc-91f7-4664-a7f1-0e37bb2777b7 became leader

opendatahub

kubelet

odh-model-controller-769875db56-h4snm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.488s (3.488s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-h4snm

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-h4snm

Started

Container started

opendatahub

llmisvc-controller-manager-869d5dcc5d-xtqsk_adaa22b7-e191-4b2b-a2e8-c0a763cfe6fb

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-xtqsk_adaa22b7-e191-4b2b-a2e8-c0a763cfe6fb became leader

opendatahub

odh-model-controller-769875db56-h4snm_96f61c70-39c5-4b50-af57-5d20cbd372a3

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-h4snm_96f61c70-39c5-4b50-af57-5d20cbd372a3 became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)