Time Namespace Component RelatedObject Reason Message

redhat-ods-applications

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

Scheduled

Successfully assigned redhat-ods-applications/kubeflow-trainer-controller-manager-6b557f7d55-mfhhb to ip-10-0-137-35.ec2.internal

redhat-ods-applications

kubeflow-trainer-controller-manager-metrics-monitor

InvalidConfiguration

"redhat-ods-applications/kubeflow-trainer-controller-manager-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: tlsConfig: failed to get ca "<secret=kubeflow-trainer-webhook-cert,key=ca.crt>": key "ca.crt" in secret "kubeflow-trainer-webhook-cert" not found

redhat-ods-applications

replicaset-controller

kubeflow-trainer-controller-manager-6b557f7d55

SuccessfulCreate

Created pod: kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

redhat-ods-applications

deployment-controller

kubeflow-trainer-controller-manager

ScalingReplicaSet

Scaled up replica set kubeflow-trainer-controller-manager-6b557f7d55 from 0 to 1

redhat-ods-applications

multus

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

redhat-ods-applications

kubelet

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

Pulling

Pulling image "quay.io/rhoai/odh-trainer-rhel9@sha256:b732fba4da2e88186a2d6eaa7e5dea0826c9a73fd629f5a03e0ec7acce8a64a6"

redhat-ods-applications

kubelet

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

Pulled

Successfully pulled image "quay.io/rhoai/odh-trainer-rhel9@sha256:b732fba4da2e88186a2d6eaa7e5dea0826c9a73fd629f5a03e0ec7acce8a64a6" in 2.238s (2.238s including waiting). Image size: 192584003 bytes.

redhat-ods-applications

kubelet

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

Created

Container created

redhat-ods-applications

kubelet

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

Started

Container started

redhat-ods-applications

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb_b4e547ac-25c0-44e9-ad9c-8e52f923ec2f

trainer.kubeflow.org

LeaderElection

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb_b4e547ac-25c0-44e9-ad9c-8e52f923ec2f became leader
(x6)

redhat-ods-applications

kubelet

kubeflow-trainer-controller-manager-6b557f7d55-mfhhb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 500