| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kuadrant-system |
authorino-c548b5d7d-stc92 |
Scheduled |
Successfully assigned kuadrant-system/authorino-c548b5d7d-stc92 to ip-10-0-137-238.ec2.internal | ||
e2e-test-llm-inference-service-b5dd93e6 |
router-gateway-2-openshift-default-56678d4c48-x75jc |
Scheduled |
Successfully assigned e2e-test-llm-inference-service-b5dd93e6/router-gateway-2-openshift-default-56678d4c48-x75jc to ip-10-0-133-215.ec2.internal | ||
e2e-test-llm-inference-service-b5dd93e6 |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Scheduled |
Successfully assigned e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz to ip-10-0-137-238.ec2.internal | ||
e2e-test-llm-inference-service-b5dd93e6 |
router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr |
Scheduled |
Successfully assigned e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr to ip-10-0-136-111.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-5677ccb49b-x4v6g |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4v6g to ip-10-0-133-215.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-66866f5fcc-7phb4 |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-66866f5fcc-7phb4 to ip-10-0-133-215.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-ccbdf686-hsv2h |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-ccbdf686-hsv2h to ip-10-0-137-238.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-774d94476f-l7cg9 |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-774d94476f-l7cg9 to ip-10-0-136-111.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-nvf9s to ip-10-0-133-215.ec2.internal | ||
kuadrant-system |
limitador-limitador-85d9db4d5d-glmwj |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-85d9db4d5d-glmwj to ip-10-0-133-215.ec2.internal | ||
kuadrant-system |
limitador-limitador-859c4d96d6-5hfqc |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-859c4d96d6-5hfqc to ip-10-0-136-111.ec2.internal | ||
kuadrant-system |
authorino-7cf4765b85-ft7f4 |
Scheduled |
Successfully assigned kuadrant-system/authorino-7cf4765b85-ft7f4 to ip-10-0-137-238.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-598f86468b-ffwbm |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-598f86468b-ffwbm to ip-10-0-137-238.ec2.internal | ||
kuadrant-system |
authorino-operator-56fb6f6856-nq65w |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-56fb6f6856-nq65w to ip-10-0-133-215.ec2.internal | ||
e2e-test-llm-inference-service-b5dd93e6 |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Scheduled |
Successfully assigned e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-75d6866649-smbnv to ip-10-0-136-111.ec2.internal | ||
kuadrant-system |
authorino-b54df94b4-74wmk |
Scheduled |
Successfully assigned kuadrant-system/authorino-b54df94b4-74wmk to ip-10-0-137-238.ec2.internal | ||
openshift-ingress |
router-default-5dc8cf7cff-gn2tw |
Scheduled |
Successfully assigned openshift-ingress/router-default-5dc8cf7cff-gn2tw to ip-10-0-136-111.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-5dc8cf7cff from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x13) | openshift-ingress |
replicaset-controller |
router-default-5dc8cf7cff |
FailedCreate |
Error creating: pods "router-default-5dc8cf7cff-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-5dc8cf7cff |
FailedCreate |
Error creating: pods "router-default-5dc8cf7cff-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-5dc8cf7cff |
SuccessfulCreate |
Created pod: router-default-5dc8cf7cff-gn2tw | |
| (x6) | openshift-ingress |
kubelet |
router-default-5dc8cf7cff-gn2tw |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x6) | openshift-ingress |
kubelet |
router-default-5dc8cf7cff-gn2tw |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
kubelet |
router-default-5dc8cf7cff-gn2tw |
Started |
Started container router | |
openshift-ingress |
kubelet |
router-default-5dc8cf7cff-gn2tw |
Created |
Created container: router | |
openshift-ingress |
kubelet |
router-default-5dc8cf7cff-gn2tw |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine | |
openshift-ingress |
multus |
router-default-5dc8cf7cff-gn2tw |
AddedInterface |
Add eth0 [10.132.0.16/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-5677ccb49b |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-5677ccb49b-x4v6g | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-x4v6g |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" | |
openshift-ingress |
multus |
istiod-openshift-gateway-5677ccb49b-x4v6g |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-x4v6g |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-x4v6g |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-x4v6g |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.356s (2.356s including waiting). Image size: 181126104 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-x4v6g |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-x4v6g |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-8699b59bbc |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-8699b59bbc-nvf9s | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-8699b59bbc from 0 to 1 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.38s (4.381s including waiting). Image size: 181318953 bytes. | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-66866f5fcc |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-66866f5fcc-7phb4 | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-66866f5fcc from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-66866f5fcc-7phb4 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-7phb4 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:8c2d9a84169e86454e4fb3df6f4846c5c5495d19b01137b6e78e113161981e47" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-774d94476f |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-774d94476f-l7cg9 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-774d94476f from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
multus |
limitador-operator-controller-manager-774d94476f-l7cg9 |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-l7cg9 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:5261170dafd0c9b5a89d3509ada864624e4aaf62a7763bf595980de5b450cc04" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-l7cg9 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:5261170dafd0c9b5a89d3509ada864624e4aaf62a7763bf595980de5b450cc04" in 2.567s (2.567s including waiting). Image size: 178551314 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
replicaset-controller |
authorino-operator-56fb6f6856 |
SuccessfulCreate |
Created pod: authorino-operator-56fb6f6856-nq65w | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-56fb6f6856 from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-l7cg9 |
Created |
Created container: manager | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-l7cg9 |
Started |
Started container manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-7phb4 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:8c2d9a84169e86454e4fb3df6f4846c5c5495d19b01137b6e78e113161981e47" in 4.676s (4.676s including waiting). Image size: 425442547 bytes. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-7phb4 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-7phb4 |
Started |
Started container manager | |
kuadrant-system |
kuadrant-operator-controller-manager-66866f5fcc-7phb4_60f1a4a7-9cfa-4802-afb8-ac1cf625eea9 |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-66866f5fcc-7phb4_60f1a4a7-9cfa-4802-afb8-ac1cf625eea9 became leader | |
kuadrant-system |
limitador-operator-controller-manager-774d94476f-l7cg9_d059c528-1b6c-4935-a00c-b2700584bc60 |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-774d94476f-l7cg9_d059c528-1b6c-4935-a00c-b2700584bc60 became leader | |
kuadrant-system |
multus |
authorino-operator-56fb6f6856-nq65w |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-nq65w |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:414262da59a55c48837807274db11cedb7da50b5984d03d3bd0445e4f7b1a0ea" | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-ccbdf686 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-ccbdf686-hsv2h | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-ccbdf686 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
multus |
dns-operator-controller-manager-ccbdf686-hsv2h |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-598f86468b from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-hsv2h |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d" | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-598f86468b |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-598f86468b-ffwbm | |
| (x2) | kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-ffwbm |
FailedMount |
MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found |
kuadrant-system |
multus |
kuadrant-console-plugin-598f86468b-ffwbm |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-ffwbm |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:1162c282e762d89acccbfb5ce9fad561fd3f807bd1929db154af3135ccc87f34" | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-hsv2h |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d" in 4.303s (4.303s including waiting). Image size: 190515353 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-hsv2h |
Started |
Started container manager | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-nq65w |
Started |
Started container manager | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-nq65w |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:414262da59a55c48837807274db11cedb7da50b5984d03d3bd0445e4f7b1a0ea" in 6.784s (6.784s including waiting). Image size: 168622690 bytes. | |
kuadrant-system |
dns-operator-controller-manager-ccbdf686-hsv2h_cb2907df-bf37-4c36-897d-2dc9bffdc833 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-ccbdf686-hsv2h_cb2907df-bf37-4c36-897d-2dc9bffdc833 became leader | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-hsv2h |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-nq65w |
Created |
Created container: manager | |
kuadrant-system |
authorino-operator-56fb6f6856-nq65w_e318dead-f1c3-456b-8e94-bcc10db617a4 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-56fb6f6856-nq65w_e318dead-f1c3-456b-8e94-bcc10db617a4 became leader | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-ffwbm |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-ffwbm |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:1162c282e762d89acccbfb5ce9fad561fd3f807bd1929db154af3135ccc87f34" in 8.721s (8.721s including waiting). Image size: 342512747 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-ffwbm |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-859c4d96d6 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-859c4d96d6 |
SuccessfulCreate |
Created pod: limitador-limitador-859c4d96d6-5hfqc | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-85d9db4d5d from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-glmwj |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" | |
kuadrant-system |
replicaset-controller |
limitador-limitador-85d9db4d5d |
SuccessfulCreate |
Created pod: limitador-limitador-85d9db4d5d-glmwj | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-b54df94b4 from 0 to 1 | |
kuadrant-system |
multus |
limitador-limitador-85d9db4d5d-glmwj |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-b54df94b4-74wmk |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" | |
kuadrant-system |
multus |
authorino-b54df94b4-74wmk |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-b54df94b4 |
SuccessfulCreate |
Created pod: authorino-b54df94b4-74wmk | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-5hfqc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-c548b5d7d from 0 to 1 | |
kuadrant-system |
multus |
limitador-limitador-859c4d96d6-5hfqc |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-c548b5d7d |
SuccessfulCreate |
Created pod: authorino-c548b5d7d-stc92 | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-stc92 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" | |
kuadrant-system |
multus |
authorino-c548b5d7d-stc92 |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-5hfqc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" in 1.322s (1.322s including waiting). Image size: 139554524 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-5hfqc |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-5hfqc |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-glmwj |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" in 1.605s (1.605s including waiting). Image size: 139554524 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-glmwj |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-glmwj |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-stc92 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" in 2.017s (2.017s including waiting). Image size: 202723116 bytes. | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-stc92 |
Started |
Started container authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-b54df94b4 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-b54df94b4-74wmk |
Created |
Created container: authorino | |
kuadrant-system |
replicaset-controller |
authorino-b54df94b4 |
SuccessfulDelete |
Deleted pod: authorino-b54df94b4-74wmk | |
kuadrant-system |
kubelet |
authorino-b54df94b4-74wmk |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-b54df94b4-74wmk |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" in 2.195s (2.195s including waiting). Image size: 202723116 bytes. | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-stc92 |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-b54df94b4-74wmk |
Killing |
Stopping container authorino | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-859c4d96d6 from 1 to 0 | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-5hfqc |
Killing |
Stopping container limitador | |
kuadrant-system |
replicaset-controller |
limitador-limitador-859c4d96d6 |
SuccessfulDelete |
Deleted pod: limitador-limitador-859c4d96d6-5hfqc | |
kuadrant-system |
replicaset-controller |
authorino-7cf4765b85 |
SuccessfulCreate |
Created pod: authorino-7cf4765b85-ft7f4 | |
kuadrant-system |
kubelet |
authorino-7cf4765b85-ft7f4 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-7cf4765b85 from 0 to 1 | |
kuadrant-system |
multus |
authorino-7cf4765b85-ft7f4 |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-7cf4765b85-ft7f4 |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-7cf4765b85-ft7f4 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" in 480ms (480ms including waiting). Image size: 202723116 bytes. | |
kuadrant-system |
kubelet |
authorino-7cf4765b85-ft7f4 |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-stc92 |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
authorino-c548b5d7d |
SuccessfulDelete |
Deleted pod: authorino-c548b5d7d-stc92 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-c548b5d7d from 1 to 0 | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
Started |
Started container istio-proxy |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine | |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
ProbeError |
Startup probe error: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-8699b59bbc-nvf9s |
Unhealthy |
Startup probe failed: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused |
e2e-test-llm-inference-service-b5dd93e6 |
replicaset-controller |
router-gateway-2-openshift-default-56678d4c48 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-56678d4c48-x75jc | |
e2e-test-llm-inference-service-b5dd93e6 |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
e2e-test-llm-inference-service-b5dd93e6 |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
e2e-test-llm-inference-service-b5dd93e6 |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-56678d4c48 from 0 to 1 | |
e2e-test-llm-inference-service-b5dd93e6 |
multus |
router-gateway-2-openshift-default-56678d4c48-x75jc |
AddedInterface |
Add eth0 [10.134.0.61/23] from ovn-kubernetes | |
e2e-test-llm-inference-service-b5dd93e6 |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x2) | e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-gateway-2-openshift-default-56678d4c48-x75jc |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-gateway-2-openshift-default-56678d4c48-x75jc |
Started |
Started container istio-proxy |
| (x2) | e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-gateway-2-openshift-default-56678d4c48-x75jc |
Created |
Created container: istio-proxy |
| (x5) | e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-gateway-2-openshift-default-56678d4c48-x75jc |
Unhealthy |
Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-role | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-self-signed-certs | |
e2e-test-llm-inference-service-b5dd93e6 |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-75d6866649 from 0 to 1 | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:3049312fa55515cbc94d5484b2c3ba6994735bde07ec862ad9b359b89e6c0af0" already present on machine | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Started |
Started container llm-d-routing-sidecar | |
e2e-test-llm-inference-service-b5dd93e6 |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-7976968fff |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr | |
e2e-test-llm-inference-service-b5dd93e6 |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-6996759666 from 0 to 1 | |
e2e-test-llm-inference-service-b5dd93e6 |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-6996759666 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-prefill | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-rb | |
e2e-test-llm-inference-service-b5dd93e6 |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-7976968fff from 0 to 1 | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-workload-svc | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Started |
Started container storage-initializer | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Created |
Created container: storage-initializer | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-epp-sa | |
e2e-test-llm-inference-service-b5dd93e6 |
multus |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
AddedInterface |
Add eth0 [10.133.0.57/23] from ovn-kubernetes | |
e2e-test-llm-inference-service-b5dd93e6 |
replicaset-controller |
router-with-refs-pd-test-kserve-75d6866649 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-75d6866649-smbnv | |
e2e-test-llm-inference-service-b5dd93e6 |
multus |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
AddedInterface |
Add eth0 [10.132.0.105/23] from ovn-kubernetes | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /e2e-test-llm-inference-service-0717dd2974684d2082af027e66405e23 | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Created |
Created container: llm-d-routing-sidecar | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr |
Created |
Created container: main | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr |
Started |
Started container main | |
| (x9) | e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-shadow-svc |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Created |
Created container: storage-initializer | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
e2e-test-llm-inference-service-b5dd93e6 |
multus |
router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr |
AddedInterface |
Add eth0 [10.132.0.106/23] from ovn-kubernetes | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:3049312fa55515cbc94d5484b2c3ba6994735bde07ec862ad9b359b89e6c0af0" already present on machine | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Started |
Started container storage-initializer | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Pulled |
Container image "vllm/vllm-openai-cpu:v0.19.0" already present on machine | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Created |
Created container: main | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Started |
Started container main | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Pulled |
Container image "vllm/vllm-openai-cpu:v0.19.0" already present on machine | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Created |
Created container: main | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Started |
Started container main | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-self-signed-certs | |
| (x11) | e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Unhealthy |
Startup probe failed: Get "https://10.133.0.57:8000/health": dial tcp 10.133.0.57:8000: connect: connection refused |
| (x11) | e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Unhealthy |
Startup probe failed: Get "https://10.132.0.105:8001/health": dial tcp 10.132.0.105:8001: connect: connection refused |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-pd-test] is Ready | |
e2e-test-llm-inference-service-b5dd93e6 |
GatewayAuthBootstrap |
router-gateway-2 |
ReconcileError |
Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-2-metrics" not found | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr |
Killing |
Stopping container main | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Killing |
Stopping container llm-d-routing-sidecar | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-75d6866649-smbnv |
Killing |
Stopping container main | |
e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-prefill-6996759666-5wdwz |
Killing |
Stopping container main | |
e2e-test-llm-inference-service-b5dd93e6 |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /e2e-test-llm-inference-service-0717dd2974684d2082af027e66405e23 | |
| (x2) | e2e-test-llm-inference-service-b5dd93e6 |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-7976968ffh49tr |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |