| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kuadrant-system |
limitador-limitador-7c9b87d574-k2cmh |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-k2cmh to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-qmz72 to ip-10-0-128-8.ec2.internal | ||
opendatahub |
test-curl-9119-8231d9 |
Scheduled |
Successfully assigned opendatahub/test-curl-9119-8231d9 to ip-10-0-128-8.ec2.internal | ||
llm |
facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m |
Scheduled |
Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m to ip-10-0-131-114.ec2.internal | ||
opendatahub |
test-curl-9119-6ad491 |
Scheduled |
Successfully assigned opendatahub/test-curl-9119-6ad491 to ip-10-0-128-8.ec2.internal | ||
opendatahub-operator-system |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Scheduled |
Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-694c67877d-7hkzw to ip-10-0-128-8.ec2.internal | ||
openshift-jobset-operator |
jobset-operator-674cd59dc5-s5q48 |
Scheduled |
Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-s5q48 to ip-10-0-131-114.ec2.internal | ||
llm |
e2e-distinct-simulated-kserve-7b998b79d9-88f27 |
Scheduled |
Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-88f27 to ip-10-0-143-70.ec2.internal | ||
cert-manager |
cert-manager-cainjector-5c57bbd4fc-kbnf2 |
Scheduled |
Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-kbnf2 to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v to ip-10-0-143-70.ec2.internal | ||
llm |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c |
Scheduled |
Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
router-default-7bf56d884f-q94vb |
FailedScheduling |
no nodes available to schedule pods | ||
openshift-ingress |
router-default-7bf56d884f-q94vb |
FailedScheduling |
no nodes available to schedule pods | ||
openshift-ingress |
router-default-7bf56d884f-q94vb |
Scheduled |
Successfully assigned openshift-ingress/router-default-7bf56d884f-q94vb to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 to ip-10-0-143-70.ec2.internal | ||
opendatahub |
usage-logs-tenancy-proxy-9c5d49bcd-jf6pz |
Scheduled |
Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jf6pz to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n to ip-10-0-143-70.ec2.internal | ||
cert-manager |
cert-manager-webhook-5dbbbf75cc-nr54r |
Scheduled |
Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-nr54r to ip-10-0-128-8.ec2.internal | ||
llm |
e2e-trlp-test-simulated-kserve-69b588897d-vfs8j |
Scheduled |
Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-vfs8j to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
payload-processing-5f78687d5b-2z78c |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-5f78687d5b-2z78c to ip-10-0-143-70.ec2.internal | ||
llm |
grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 |
Scheduled |
Successfully assigned llm/grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
data-science-gateway-data-science-gateway-class-7d45d5c789s5bx6 |
Scheduled |
Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7d45d5c789s5bx6 to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d to ip-10-0-143-70.ec2.internal | ||
llm |
e2e-embedding-simulated-kserve-67bf594cd6-2brd8 |
Scheduled |
Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-2brd8 to ip-10-0-131-114.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-66c4fb575d-j6bv6 |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-j6bv6 to ip-10-0-128-8.ec2.internal | ||
llm |
echo-simulator-kserve-64b6f8f96c-2s96l |
Scheduled |
Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-2s96l to ip-10-0-143-70.ec2.internal | ||
llm |
grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c |
Scheduled |
Successfully assigned llm/grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c to ip-10-0-131-114.ec2.internal | ||
openshift-jobset-operator |
jobset-controller-manager-599c9f7fb5-t7nzd |
Scheduled |
Successfully assigned openshift-jobset-operator/jobset-controller-manager-599c9f7fb5-t7nzd to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
payload-pre-processing-7b98bb678c-xwtgm |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-xwtgm to ip-10-0-143-70.ec2.internal | ||
kuadrant-system |
authorino-56c6c9ddd5-cqcrc |
Scheduled |
Successfully assigned kuadrant-system/authorino-56c6c9ddd5-cqcrc to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-w85rr |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-w85rr to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-thwmn |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-thwmn to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-rscbr |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-rscbr to ip-10-0-128-8.ec2.internal | ||
opendatahub |
test-curl-9119-340830 |
Scheduled |
Successfully assigned opendatahub/test-curl-9119-340830 to ip-10-0-128-8.ec2.internal | ||
opendatahub |
odh-model-controller-769875db56-7fqmg |
Scheduled |
Successfully assigned opendatahub/odh-model-controller-769875db56-7fqmg to ip-10-0-128-8.ec2.internal | ||
opendatahub |
model-serving-api-75bd89fdfc-87xtz |
Scheduled |
Successfully assigned opendatahub/model-serving-api-75bd89fdfc-87xtz to ip-10-0-128-8.ec2.internal | ||
opendatahub |
maas-controller-786557dc8d-jl66j |
Scheduled |
Successfully assigned opendatahub/maas-controller-786557dc8d-jl66j to ip-10-0-143-70.ec2.internal | ||
opendatahub |
maas-controller-549f8dc96d-cgbqf |
Scheduled |
Successfully assigned opendatahub/maas-controller-549f8dc96d-cgbqf to ip-10-0-143-70.ec2.internal | ||
kuadrant-system |
authorino-57f7f8659f-s5jsz |
Scheduled |
Successfully assigned kuadrant-system/authorino-57f7f8659f-s5jsz to ip-10-0-131-114.ec2.internal | ||
opendatahub |
llmisvc-controller-manager-869d5dcc5d-952vq |
Scheduled |
Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-952vq to ip-10-0-128-8.ec2.internal | ||
opendatahub |
llmisvc-controller-manager-6466c554d8-cwlq7 |
Scheduled |
Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-cwlq7 to ip-10-0-128-8.ec2.internal | ||
kuadrant-system |
limitador-limitador-74dfcfb894-n9k8l |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-n9k8l to ip-10-0-143-70.ec2.internal | ||
opendatahub |
kserve-module-controller-manager-7566cf5fc8-f4x94 |
Scheduled |
Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-f4x94 to ip-10-0-143-70.ec2.internal | ||
opendatahub |
kserve-controller-manager-776cc66d47-bpdr9 |
Scheduled |
Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-bpdr9 to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-j8gnl to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-gnw8g to ip-10-0-143-70.ec2.internal | ||
cert-manager |
cert-manager-597b95cb84-v96gv |
Scheduled |
Successfully assigned cert-manager/cert-manager-597b95cb84-v96gv to ip-10-0-143-70.ec2.internal | ||
kuadrant-system |
authorino-5bfdbf97c8-7g9p8 |
Scheduled |
Successfully assigned kuadrant-system/authorino-5bfdbf97c8-7g9p8 to ip-10-0-128-8.ec2.internal | ||
opendatahub |
ai-gateway-controller-7d85675f98-79cgw |
Scheduled |
Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-79cgw to ip-10-0-143-70.ec2.internal | ||
opendatahub |
ai-gateway-controller-685898bb78-ztzsp |
Scheduled |
Successfully assigned opendatahub/ai-gateway-controller-685898bb78-ztzsp to ip-10-0-143-70.ec2.internal | ||
llm |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
Scheduled |
Successfully assigned llm/grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-7876bfcb74-h94gb |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-h94gb to ip-10-0-143-70.ec2.internal | ||
llm |
e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 |
Scheduled |
Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw to ip-10-0-131-114.ec2.internal | ||
opendatahub-operator-system |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Scheduled |
Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-694c67877d-ht76h to ip-10-0-131-114.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-5778bb4449-chb74 |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-chb74 to ip-10-0-131-114.ec2.internal | ||
kuadrant-system |
authorino-6889cbd8c4-pkg5b |
Scheduled |
Successfully assigned kuadrant-system/authorino-6889cbd8c4-pkg5b to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-fwvvf to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-8ncd4 to ip-10-0-143-70.ec2.internal | ||
kuadrant-system |
authorino-68b69c6bbd-rhnpq |
Scheduled |
Successfully assigned kuadrant-system/authorino-68b69c6bbd-rhnpq to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-566g7 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-566g7 to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-7854949c9-44fbq |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7854949c9-44fbq to ip-10-0-131-114.ec2.internal | ||
llm |
grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg |
Scheduled |
Successfully assigned llm/grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg to ip-10-0-143-70.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-678d87766f-kbnmq |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-kbnmq to ip-10-0-131-114.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 to ip-10-0-128-8.ec2.internal | ||
kuadrant-system |
authorino-operator-7b7bb4bc77-tlctc |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-tlctc to ip-10-0-128-8.ec2.internal | ||
opendatahub-operator-system |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Scheduled |
Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-694c67877d-qzdtj to ip-10-0-143-70.ec2.internal | ||
openshift-ingress |
kube-auth-proxy-74f544c66f-zbpk8 |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-74f544c66f-zbpk8 to ip-10-0-131-114.ec2.internal | ||
kuadrant-system |
authorino-6f6944bcdd-cg4zt |
Scheduled |
Successfully assigned kuadrant-system/authorino-6f6944bcdd-cg4zt to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
kube-auth-proxy-74f544c66f-xq9bc |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-74f544c66f-xq9bc to ip-10-0-128-8.ec2.internal | ||
llm |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w |
Scheduled |
Successfully assigned llm/grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w to ip-10-0-143-70.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-cf8469d7b-ftshs |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ftshs to ip-10-0-131-114.ec2.internal | ||
llm |
premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d |
Scheduled |
Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d to ip-10-0-131-114.ec2.internal | ||
opendatahub |
test-curl-9119-9ee1e9 |
Scheduled |
Successfully assigned opendatahub/test-curl-9119-9ee1e9 to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jg4xk to ip-10-0-131-114.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-8557cbdb84-zzmpq |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-zzmpq to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c to ip-10-0-143-70.ec2.internal | ||
kuadrant-system |
authorino-b79864c75-hs2nj |
Scheduled |
Successfully assigned kuadrant-system/authorino-b79864c75-hs2nj to ip-10-0-131-114.ec2.internal | ||
llm |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 |
Scheduled |
Successfully assigned llm/grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 to ip-10-0-128-8.ec2.internal | ||
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-7bf56d884f from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
replicaset-controller |
router-default-7bf56d884f |
FailedCreate |
Error creating: pods "router-default-7bf56d884f-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range | |
openshift-ingress |
replicaset-controller |
router-default-7bf56d884f |
SuccessfulCreate |
Created pod: router-default-7bf56d884f-q94vb | |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
| (x5) | openshift-ingress |
kubelet |
router-default-7bf56d884f-q94vb |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x5) | openshift-ingress |
kubelet |
router-default-7bf56d884f-q94vb |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
kubelet |
router-default-7bf56d884f-q94vb |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt | |
| (x3) | openshift-ingress |
kubelet |
router-default-7bf56d884f-q94vb |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
multus |
router-default-7bf56d884f-q94vb |
AddedInterface |
Add eth0 [10.132.0.19/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-7bf56d884f-q94vb |
Started |
Container started | |
openshift-ingress |
kubelet |
router-default-7bf56d884f-q94vb |
Created |
Container created | |
openshift-ingress |
kubelet |
router-default-7bf56d884f-q94vb |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod | |
openshift-ingress |
gateway_labeler_controller |
maas-default-gateway |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7876bfcb74 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7876bfcb74-h94gb | |
openshift-ingress |
multus |
istiod-openshift-gateway-7876bfcb74-h94gb |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-h94gb |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-h94gb |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.951s (4.951s including waiting). Image size: 185476477 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-h94gb |
Created |
Container created | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-h94gb |
Started |
Container started | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-ai-inference |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-h94gb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-7854949c9 from 0 to 1 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-h94gb |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-fwvvf | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-ai-inference |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-ai-inference-6f8685f4cf from 0 to 1 | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-ai-inference-6f8685f4cf |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-ai-inference |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 10.166s (10.166s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw |
Created |
Container created | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-6f8685f4cf-8nkpw |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 10.285s (10.285s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
RequirementsUnknown |
requirements not yet checked | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
InstallSucceeded |
waiting for install components to report healthy |
| (x2) | openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
InstallWaiting |
installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability. |
openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
AllRequirementsMet |
all requirements found, attempting install | |
openshift-jobset-operator |
deployment-controller |
jobset-operator |
ScalingReplicaSet |
Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1 | |
openshift-jobset-operator |
replicaset-controller |
jobset-operator-674cd59dc5 |
SuccessfulCreate |
Created pod: jobset-operator-674cd59dc5-s5q48 | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-s5q48 |
Pulling |
Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" | |
openshift-jobset-operator |
multus |
jobset-operator-674cd59dc5-s5q48 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
InstallSucceeded |
install strategy completed with no errors | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-s5q48 |
Started |
Container started | |
openshift-jobset-operator |
openshift-jobset-operator |
openshift-jobset-operator-lock |
LeaderElection |
jobset-operator-674cd59dc5-s5q48_d1c04c1e-3e69-4955-91d7-7b9e80610a45 became leader | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-s5q48 |
Pulled |
Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 1.822s (1.822s including waiting). Image size: 224874686 bytes. | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-s5q48 |
Created |
Container created | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
multus |
limitador-operator-controller-manager-5778bb4449-chb74 |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-5778bb4449 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-5778bb4449-chb74 | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-chb74 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-chb74 |
Started |
Container started | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-chb74 |
Created |
Container created | |
kuadrant-system |
limitador-operator-controller-manager-5778bb4449-chb74_d55dfef1-a00b-4f4c-83f4-6ac5e4ab5629 |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-5778bb4449-chb74_d55dfef1-a00b-4f4c-83f4-6ac5e4ab5629 became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-chb74 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.294s (2.294s including waiting). Image size: 177967631 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-cf8469d7b |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-cf8469d7b-ftshs | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-cf8469d7b-ftshs |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-cf8469d7b-ftshs |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
RequirementsUnknown |
requirements not yet checked | |
opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
opendatahub-operator-system |
deployment-controller |
opendatahub-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set opendatahub-operator-controller-manager-694c67877d from 0 to 3 | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-8557cbdb84 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-8557cbdb84-zzmpq | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
opendatahub-operator-system |
replicaset-controller |
opendatahub-operator-controller-manager-694c67877d |
SuccessfulCreate |
Created pod: opendatahub-operator-controller-manager-694c67877d-qzdtj | |
opendatahub-operator-system |
replicaset-controller |
opendatahub-operator-controller-manager-694c67877d |
SuccessfulCreate |
Created pod: opendatahub-operator-controller-manager-694c67877d-ht76h | |
opendatahub-operator-system |
replicaset-controller |
opendatahub-operator-controller-manager-694c67877d |
SuccessfulCreate |
Created pod: opendatahub-operator-controller-manager-694c67877d-7hkzw | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1 | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
multus |
opendatahub-operator-controller-manager-694c67877d-ht76h |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
RequirementsUnknown |
requirements not yet checked | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-zzmpq |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" | |
opendatahub-operator-system |
multus |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
opendatahub-operator-system |
multus |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
AddedInterface |
Add eth0 [10.134.0.19/23] from ovn-kubernetes | |
kuadrant-system |
multus |
dns-operator-controller-manager-8557cbdb84-zzmpq |
AddedInterface |
Add eth0 [10.134.0.20/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.643s (2.643s including waiting). Image size: 273709574 bytes. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-cf8469d7b-ftshs |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 6.515s (6.515s including waiting). Image size: 424244516 bytes. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-cf8469d7b-ftshs |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Started |
Container started | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-cf8469d7b-ftshs |
Started |
Container started | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.607s (2.607s including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Started |
Container started | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Started |
Container started | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.05s (3.05s including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kuadrant-operator-controller-manager-cf8469d7b-ftshs_0e9aba14-7b00-4fa8-b455-c45087fde559 |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-cf8469d7b-ftshs_0e9aba14-7b00-4fa8-b455-c45087fde559 became leader | |
| (x2) | opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
InstallWaiting |
installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability. |
kuadrant-system |
replicaset-controller |
authorino-operator-7b7bb4bc77 |
SuccessfulCreate |
Created pod: authorino-operator-7b7bb4bc77-tlctc | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-tlctc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1 | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 377ms (377ms including waiting). Image size: 273709574 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
InstallSucceeded |
waiting for install components to report healthy | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-7hkzw |
Started |
Container started | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 318ms (318ms including waiting). Image size: 273709574 bytes. | |
kuadrant-system |
multus |
authorino-operator-7b7bb4bc77-tlctc |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-qzdtj |
Started |
Container started | |
opendatahub-operator-system |
opendatahub-operator-controller-manager-694c67877d-qzdtj_3abcbad0-45d7-49c8-9cec-7aaef910514f |
07ed84f7.opendatahub.io |
LeaderElection |
opendatahub-operator-controller-manager-694c67877d-qzdtj_3abcbad0-45d7-49c8-9cec-7aaef910514f became leader | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 315ms (315ms including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-694c67877d-ht76h |
Started |
Container started | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1 | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-j6bv6 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-66c4fb575d |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-66c4fb575d-j6bv6 | |
kuadrant-system |
multus |
kuadrant-console-plugin-66c4fb575d-j6bv6 |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kuadrant-system |
authorino-operator-7b7bb4bc77-tlctc_605d8bae-cefb-47c8-9a30-8d376781d1e7 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-7b7bb4bc77-tlctc_605d8bae-cefb-47c8-9a30-8d376781d1e7 became leader | |
kuadrant-system |
dns-operator-controller-manager-8557cbdb84-zzmpq_93afb345-9096-4c96-a480-514d46c82bb2 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-8557cbdb84-zzmpq_93afb345-9096-4c96-a480-514d46c82bb2 became leader | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-tlctc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.7s (2.7s including waiting). Image size: 167738465 bytes. | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-tlctc |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-tlctc |
Started |
Container started | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-zzmpq |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 6.646s (6.646s including waiting). Image size: 190804149 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-zzmpq |
Created |
Container created | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-zzmpq |
Started |
Container started | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-j6bv6 |
Started |
Container started | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-j6bv6 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.561s (4.561s including waiting). Image size: 342538866 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-j6bv6 |
Created |
Container created | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallWaiting |
installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallSucceeded |
waiting for install components to report healthy |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-678d87766f |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-678d87766f-kbnmq | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-678d87766f-kbnmq |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-kbnmq |
Pulled |
Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-kbnmq |
Created |
Container created | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-kbnmq |
Started |
Container started | |
cert-manager |
deployment-controller |
cert-manager |
ScalingReplicaSet |
Scaled up replica set cert-manager-597b95cb84 from 0 to 1 | |
cert-manager |
deployment-controller |
cert-manager-cainjector |
ScalingReplicaSet |
Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1 | |
opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
InstallSucceeded |
install strategy completed with no errors | |
| (x9) | cert-manager |
replicaset-controller |
cert-manager-cainjector-5c57bbd4fc |
FailedCreate |
Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
cert-manager |
replicaset-controller |
cert-manager-cainjector-5c57bbd4fc |
SuccessfulCreate |
Created pod: cert-manager-cainjector-5c57bbd4fc-kbnf2 | |
cert-manager |
multus |
cert-manager-cainjector-5c57bbd4fc-kbnf2 |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-kbnf2 |
Pulling |
Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" | |
| (x11) | cert-manager |
replicaset-controller |
cert-manager-597b95cb84 |
FailedCreate |
Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found |
cert-manager |
replicaset-controller |
cert-manager-webhook-5dbbbf75cc |
SuccessfulCreate |
Created pod: cert-manager-webhook-5dbbbf75cc-nr54r | |
cert-manager |
deployment-controller |
cert-manager-webhook |
ScalingReplicaSet |
Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1 | |
cert-manager |
multus |
cert-manager-webhook-5dbbbf75cc-nr54r |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-nr54r |
Pulling |
Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-nr54r |
Pulled |
Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.309s (2.309s including waiting). Image size: 309650901 bytes. | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-kbnf2 |
Started |
Container started | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-kbnf2 |
Created |
Container created | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-kbnf2 |
Pulled |
Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.735s (5.735s including waiting). Image size: 309650901 bytes. | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-nr54r |
Created |
Container created | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-nr54r |
Started |
Container started | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-cf8469d7b-ftshs |
Killing |
Stopping container manager | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0 | |
cert-manager |
replicaset-controller |
cert-manager-597b95cb84 |
SuccessfulCreate |
Created pod: cert-manager-597b95cb84-v96gv | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-cf8469d7b |
SuccessfulDelete |
Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-ftshs | |
cert-manager |
multus |
cert-manager-597b95cb84-v96gv |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
cert-manager |
kubelet |
cert-manager-597b95cb84-v96gv |
Pulling |
Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallSucceeded |
install strategy completed with no errors | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleCreated |
Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ServiceAccountCreated |
Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ServiceCreated |
Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleCreated |
Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing | |
cert-manager |
kubelet |
cert-manager-597b95cb84-v96gv |
Started |
Container started | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleCreated |
Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing | |
openshift-ingress |
deployment-controller |
data-science-gateway-data-science-gateway-class |
ScalingReplicaSet |
Scaled up replica set data-science-gateway-data-science-gateway-class-7d45d5c789 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
data-science-gateway-data-science-gateway-class-7d45d5c789 |
SuccessfulCreate |
Created pod: data-science-gateway-data-science-gateway-class-7d45d5c789s5bx6 | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-74f544c66f |
SuccessfulCreate |
Created pod: kube-auth-proxy-74f544c66f-xq9bc | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleBindingCreated |
Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleBindingCreated |
Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleBindingCreated |
Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleCreated |
Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing | |
cert-manager |
kubelet |
cert-manager-597b95cb84-v96gv |
Created |
Container created | |
cert-manager |
kubelet |
cert-manager-597b95cb84-v96gv |
Pulled |
Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.895s (2.895s including waiting). Image size: 309650901 bytes. | |
openshift-ingress |
deployment-controller |
kube-auth-proxy |
ScalingReplicaSet |
Scaled up replica set kube-auth-proxy-74f544c66f from 0 to 2 | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-74f544c66f |
SuccessfulCreate |
Created pod: kube-auth-proxy-74f544c66f-zbpk8 | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleBindingCreated |
Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing | |
openshift-ingress |
multus |
kube-auth-proxy-74f544c66f-zbpk8 |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ServiceCreated |
Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing | |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-zbpk8 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleBindingCreated |
Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleCreated |
Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing | |
openshift-ingress |
multus |
data-science-gateway-data-science-gateway-class-7d45d5c789s5bx6 |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-7d45d5c789s5bx6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-xq9bc |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" | |
openshift-ingress |
multus |
kube-auth-proxy-74f544c66f-xq9bc |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-7d45d5c789s5bx6 |
Started |
Container started | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-7d45d5c789s5bx6 |
Created |
Container created | |
| (x4) | openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
IssuerCreateFailed |
Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook" |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-xq9bc |
Started |
Container started | |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-xq9bc |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.211s (2.211s including waiting). Image size: 188904677 bytes. | |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-xq9bc |
Created |
Container created | |
opendatahub |
deployment-controller |
kserve-module-controller-manager |
ScalingReplicaSet |
Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 | |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-zbpk8 |
Created |
Container created | |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-zbpk8 |
Started |
Container started | |
opendatahub |
replicaset-controller |
kserve-module-controller-manager-7566cf5fc8 |
SuccessfulCreate |
Created pod: kserve-module-controller-manager-7566cf5fc8-f4x94 | |
openshift-ingress |
kubelet |
kube-auth-proxy-74f544c66f-zbpk8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.884s (2.884s including waiting). Image size: 188904677 bytes. | |
opendatahub |
multus |
kserve-module-controller-manager-7566cf5fc8-f4x94 |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-f4x94 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-f4x94 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.135s (2.135s including waiting). Image size: 195729000 bytes. | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-f4x94 |
Created |
Container created | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-f4x94 |
Started |
Container started | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kuadrant-system |
kuadrant-operator-controller-manager-678d87766f-kbnmq_22c6f7a5-2f42-4747-8b5d-147faad18980 |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-678d87766f-kbnmq_22c6f7a5-2f42-4747-8b5d-147faad18980 became leader | |
kuadrant-system |
replicaset-controller |
limitador-limitador-74dfcfb894 |
SuccessfulCreate |
Created pod: limitador-limitador-74dfcfb894-n9k8l | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-57f7f8659f from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-57f7f8659f |
SuccessfulCreate |
Created pod: authorino-57f7f8659f-s5jsz | |
kuadrant-system |
multus |
limitador-limitador-74dfcfb894-n9k8l |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-n9k8l |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" | |
kuadrant-system |
multus |
authorino-57f7f8659f-s5jsz |
AddedInterface |
Add eth0 [10.133.0.40/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-k2cmh |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" | |
kuadrant-system |
replicaset-controller |
limitador-limitador-7c9b87d574 |
SuccessfulCreate |
Created pod: limitador-limitador-7c9b87d574-k2cmh | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-cqcrc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
replicaset-controller |
authorino-56c6c9ddd5 |
SuccessfulCreate |
Created pod: authorino-56c6c9ddd5-cqcrc | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1 | |
kuadrant-system |
multus |
authorino-56c6c9ddd5-cqcrc |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kuadrant-system |
multus |
limitador-limitador-7c9b87d574-k2cmh |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-56c6c9ddd5 from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-s5jsz |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-n9k8l |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-s5jsz |
Started |
Container started | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-k2cmh |
Created |
Container created | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-k2cmh |
Started |
Container started | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-k2cmh |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.071s (1.071s including waiting). Image size: 133379307 bytes. | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-s5jsz |
Created |
Container created | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-n9k8l |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.234s (2.234s including waiting). Image size: 133379307 bytes. | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-s5jsz |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.679s (1.679s including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-n9k8l |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-cqcrc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.507s (1.507s including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-cqcrc |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-cqcrc |
Started |
Container started | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-57f7f8659f from 1 to 0 | |
opendatahub |
kserve-module-controller-manager-7566cf5fc8-f4x94_6b442ce2-2767-4e64-a54a-d56c898321c2 |
kserve-module-controller-manager |
LeaderElection |
kserve-module-controller-manager-7566cf5fc8-f4x94_6b442ce2-2767-4e64-a54a-d56c898321c2 became leader | |
kuadrant-system |
replicaset-controller |
authorino-57f7f8659f |
SuccessfulDelete |
Deleted pod: authorino-57f7f8659f-s5jsz | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-s5jsz |
Killing |
Stopping container authorino | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-n9k8l |
Killing |
Stopping container limitador | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-74dfcfb894 |
SuccessfulDelete |
Deleted pod: limitador-limitador-74dfcfb894-n9k8l | |
openshift-jobset-operator |
cert-manager-certificates-trigger |
jobset-metrics-cert |
Issuing |
Issuing certificate as Secret does not exist | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-acme |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-approver |
jobset-serving-cert-1 |
cert-manager.io |
Certificate request has been approved by cert-manager.io | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
CertificateCreated |
Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
cert-manager-certificates-issuing |
jobset-metrics-cert |
Issuing |
The certificate has been successfully issued | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
CertificateCreated |
Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
IssuerCreated |
Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-metrics-cert-1 |
CertificateIssued |
Certificate fetched from issuer successfully | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-ca |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-venafi |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificates-issuing |
jobset-serving-cert |
Issuing |
The certificate has been successfully issued | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-venafi |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-serving-cert-1 |
CertificateIssued |
Certificate fetched from issuer successfully | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-vault |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-vault |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-ca |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-acme |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificates-key-manager |
jobset-serving-cert |
Generated |
Stored new private key in temporary Secret resource "jobset-serving-cert-6fclq" | |
openshift-jobset-operator |
cert-manager-certificates-trigger |
jobset-serving-cert |
Issuing |
Issuing certificate as Secret does not exist | |
openshift-jobset-operator |
cert-manager-certificates-key-manager |
jobset-metrics-cert |
Generated |
Stored new private key in temporary Secret resource "jobset-metrics-cert-xhrrc" | |
openshift-jobset-operator |
cert-manager-certificates-request-manager |
jobset-serving-cert |
Requested |
Created new CertificateRequest resource "jobset-serving-cert-1" | |
openshift-jobset-operator |
cert-manager-certificaterequests-approver |
jobset-metrics-cert-1 |
cert-manager.io |
Certificate request has been approved by cert-manager.io | |
openshift-jobset-operator |
cert-manager-certificates-request-manager |
jobset-metrics-cert |
Requested |
Created new CertificateRequest resource "jobset-metrics-cert-1" | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ConfigMapCreated |
Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
DeploymentCreated |
Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
RoleCreated |
Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
deployment-controller |
jobset-controller-manager |
ScalingReplicaSet |
Scaled up replica set jobset-controller-manager-599c9f7fb5 from 0 to 1 | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ValidatingWebhookConfigurationCreated |
Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ServiceMonitorCreated |
Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
RoleBindingCreated |
Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
MutatingWebhookConfigurationCreated |
Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
CustomResourceDefinitionCreated |
Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-599c9f7fb5-t7nzd |
Pulling |
Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ValidatingWebhookConfigurationUpdated |
Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
MutatingWebhookConfigurationUpdated |
Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed | |
openshift-jobset-operator |
multus |
jobset-controller-manager-599c9f7fb5-t7nzd |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
openshift-jobset-operator |
replicaset-controller |
jobset-controller-manager-599c9f7fb5 |
SuccessfulCreate |
Created pod: jobset-controller-manager-599c9f7fb5-t7nzd | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-599c9f7fb5-t7nzd |
Pulled |
Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.526s (2.526s including waiting). Image size: 182184678 bytes. | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-599c9f7fb5-t7nzd |
Created |
Container created | |
openshift-jobset-operator |
jobset-controller-manager-599c9f7fb5-t7nzd_aa4ec0d7-6ed8-4e1c-b247-d6ca6822ab45 |
6d4f6a47.jobset.x-k8s.io |
LeaderElection |
jobset-controller-manager-599c9f7fb5-t7nzd_aa4ec0d7-6ed8-4e1c-b247-d6ca6822ab45 became leader | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-599c9f7fb5-t7nzd |
Started |
Container started | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
data-science-gateway-data-science-gateway-class |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
data-science-gateway-data-science-gateway-class |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7ddd9cfdc8 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7ddd9cfdc8-jg4xk | |
opendatahub |
replicaset-controller |
model-serving-api-75bd89fdfc |
SuccessfulCreate |
Created pod: model-serving-api-75bd89fdfc-87xtz | |
opendatahub |
replicaset-controller |
llmisvc-controller-manager-869d5dcc5d |
SuccessfulCreate |
Created pod: llmisvc-controller-manager-869d5dcc5d-952vq | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" | |
openshift-ingress |
multus |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
AddedInterface |
Add eth0 [10.133.0.42/23] from ovn-kubernetes | |
opendatahub |
deployment-controller |
model-serving-api |
ScalingReplicaSet |
Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 | |
opendatahub |
replicaset-controller |
odh-model-controller-769875db56 |
SuccessfulCreate |
Created pod: odh-model-controller-769875db56-7fqmg | |
opendatahub |
deployment-controller |
odh-model-controller |
ScalingReplicaSet |
Scaled up replica set odh-model-controller-769875db56 from 0 to 1 | |
opendatahub |
replicaset-controller |
kserve-controller-manager-776cc66d47 |
SuccessfulCreate |
Created pod: kserve-controller-manager-776cc66d47-bpdr9 | |
opendatahub |
deployment-controller |
kserve-controller-manager |
ScalingReplicaSet |
Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 | |
opendatahub |
deployment-controller |
llmisvc-controller-manager |
ScalingReplicaSet |
Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-bpdr9 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-952vq |
Pulling |
Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" | |
opendatahub |
multus |
llmisvc-controller-manager-869d5dcc5d-952vq |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
opendatahub |
kubelet |
odh-model-controller-769875db56-7fqmg |
Pulling |
Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" | |
opendatahub |
multus |
model-serving-api-75bd89fdfc-87xtz |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
opendatahub |
multus |
kserve-controller-manager-776cc66d47-bpdr9 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-87xtz |
Pulling |
Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" | |
opendatahub |
multus |
odh-model-controller-769875db56-7fqmg |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.277s (3.277s including waiting). Image size: 185476477 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
Started |
Container started | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
Created |
Container created | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-952vq |
Created |
Container created | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-87xtz |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.83s (2.83s including waiting). Image size: 184925761 bytes. | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-bpdr9 |
Started |
Container started | |
opendatahub |
kubelet |
odh-model-controller-769875db56-7fqmg |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.37s (3.37s including waiting). Image size: 236755567 bytes. | |
opendatahub |
kubelet |
odh-model-controller-769875db56-7fqmg |
Created |
Container created | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
opendatahub |
kubelet |
odh-model-controller-769875db56-7fqmg |
Started |
Container started | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-bpdr9 |
Created |
Container created | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-952vq |
Started |
Container started | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-87xtz |
Started |
Container started | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-87xtz |
Created |
Container created | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-bpdr9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.032s (3.032s including waiting). Image size: 247676581 bytes. | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-952vq |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.845s (2.845s including waiting). Image size: 235100981 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-jg4xk |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7876bfcb74 |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7876bfcb74-h94gb | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-h94gb |
Killing |
Stopping container discovery | |
opendatahub |
odh-model-controller-769875db56-7fqmg_60c51718-5172-4d14-bafd-f88d6c281918 |
odh-model-controller.opendatahub.io |
LeaderElection |
odh-model-controller-769875db56-7fqmg_60c51718-5172-4d14-bafd-f88d6c281918 became leader | |
opendatahub |
llmisvc-controller-manager-869d5dcc5d-952vq_84019f9c-e89d-480c-ac14-50014409bede |
llminferenceservice-kserve-controller-manager |
LeaderElection |
llmisvc-controller-manager-869d5dcc5d-952vq_84019f9c-e89d-480c-ac14-50014409bede became leader | |
opendatahub |
kserve-controller-manager-776cc66d47-bpdr9_54b72751-f6fe-43a0-97ca-05adb8bf5e76 |
kserve-controller-manager-leader-lock |
LeaderElection |
kserve-controller-manager-776cc66d47-bpdr9_54b72751-f6fe-43a0-97ca-05adb8bf5e76 became leader | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
opendatahub |
replicaset-controller |
maas-controller-786557dc8d |
SuccessfulCreate |
Created pod: maas-controller-786557dc8d-jl66j | |
opendatahub |
deployment-controller |
maas-controller |
ScalingReplicaSet |
Scaled up replica set maas-controller-786557dc8d from 0 to 1 | |
opendatahub |
deployment-controller |
maas-controller |
ScalingReplicaSet |
Scaled up replica set maas-controller-549f8dc96d from 0 to 1 | |
opendatahub |
kubelet |
maas-controller-786557dc8d-jl66j |
Pulling |
Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" | |
opendatahub |
multus |
maas-controller-786557dc8d-jl66j |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
opendatahub |
replicaset-controller |
maas-controller-549f8dc96d |
SuccessfulCreate |
Created pod: maas-controller-549f8dc96d-cgbqf | |
opendatahub |
multus |
maas-controller-549f8dc96d-cgbqf |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
opendatahub |
kubelet |
maas-controller-549f8dc96d-cgbqf |
Pulling |
Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" | |
opendatahub |
kubelet |
maas-controller-549f8dc96d-cgbqf |
Created |
Container created | |
opendatahub |
kubelet |
maas-controller-549f8dc96d-cgbqf |
Started |
Container started | |
opendatahub |
kubelet |
maas-controller-549f8dc96d-cgbqf |
Pulled |
Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.53s (2.53s including waiting). Image size: 200069630 bytes. | |
opendatahub |
kubelet |
maas-controller-786557dc8d-jl66j |
Pulled |
Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.689s (2.689s including waiting). Image size: 200069630 bytes. | |
opendatahub |
kubelet |
maas-controller-786557dc8d-jl66j |
Created |
Container created | |
opendatahub |
kubelet |
maas-controller-786557dc8d-jl66j |
Started |
Container started | |
opendatahub |
maas-controller-786557dc8d-jl66j_72b0e116-144a-4460-82f5-4b88588ffebc |
maas-controller.models-as-a-service.opendatahub.io |
LeaderElection |
maas-controller-786557dc8d-jl66j_72b0e116-144a-4460-82f5-4b88588ffebc became leader | |
opendatahub |
deployment-controller |
usage-logs-tenancy-proxy |
ScalingReplicaSet |
Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 | |
opendatahub |
replicaset-controller |
usage-logs-tenancy-proxy-9c5d49bcd |
SuccessfulCreate |
Created pod: usage-logs-tenancy-proxy-9c5d49bcd-jf6pz | |
opendatahub |
multus |
usage-logs-tenancy-proxy-9c5d49bcd-jf6pz |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-jf6pz |
Pulling |
Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" | |
opendatahub |
deployment-controller |
maas-controller |
ScalingReplicaSet |
Scaled down replica set maas-controller-786557dc8d from 1 to 0 | |
opendatahub |
replicaset-controller |
maas-controller-786557dc8d |
SuccessfulDelete |
Deleted pod: maas-controller-786557dc8d-jl66j | |
opendatahub |
kubelet |
maas-controller-786557dc8d-jl66j |
Killing |
Stopping container manager | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Started |
Container started |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-jf6pz |
Pulled |
Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 9.742s (9.742s including waiting). Image size: 1089502687 bytes. | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-jf6pz |
Created |
Container created | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-jf6pz |
Started |
Container started | |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
ProbeError |
Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Unhealthy |
Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
opendatahub |
maas-controller-549f8dc96d-cgbqf_37c7038b-8b3e-4d26-84ac-2b7147d51544 |
maas-controller.models-as-a-service.opendatahub.io |
LeaderElection |
maas-controller-549f8dc96d-cgbqf_37c7038b-8b3e-4d26-84ac-2b7147d51544 became leader | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kuadrant-system |
replicaset-controller |
authorino-6f6944bcdd |
SuccessfulCreate |
Created pod: authorino-6f6944bcdd-cg4zt | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-6f6944bcdd from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-6889cbd8c4 from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-6889cbd8c4 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-cg4zt |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
kubelet |
authorino-5bfdbf97c8-7g9p8 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
replicaset-controller |
authorino-6f6944bcdd |
SuccessfulDelete |
Deleted pod: authorino-6f6944bcdd-cg4zt | |
kuadrant-system |
multus |
authorino-6f6944bcdd-cg4zt |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-6f6944bcdd from 1 to 0 | |
kuadrant-system |
replicaset-controller |
authorino-5bfdbf97c8 |
SuccessfulCreate |
Created pod: authorino-5bfdbf97c8-7g9p8 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-5bfdbf97c8 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-6889cbd8c4 |
SuccessfulCreate |
Created pod: authorino-6889cbd8c4-pkg5b | |
kuadrant-system |
multus |
authorino-5bfdbf97c8-7g9p8 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-6889cbd8c4 |
SuccessfulDelete |
Deleted pod: authorino-6889cbd8c4-pkg5b | |
kuadrant-system |
kubelet |
authorino-5bfdbf97c8-7g9p8 |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-5bfdbf97c8-7g9p8 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 413ms (413ms including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-cg4zt |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-cg4zt |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 749ms (749ms including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-cg4zt |
Killing |
Stopping container authorino | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-cg4zt |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-5bfdbf97c8-7g9p8 |
Created |
Container created | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-56c6c9ddd5 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-cqcrc |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
authorino-56c6c9ddd5 |
SuccessfulDelete |
Deleted pod: authorino-56c6c9ddd5-cqcrc | |
kuadrant-system |
replicaset-controller |
authorino-68b69c6bbd |
SuccessfulCreate |
Created pod: authorino-68b69c6bbd-rhnpq | |
kuadrant-system |
kubelet |
authorino-68b69c6bbd-rhnpq |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-68b69c6bbd-rhnpq |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 421ms (421ms including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
multus |
authorino-68b69c6bbd-rhnpq |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-68b69c6bbd-rhnpq |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-68b69c6bbd-rhnpq |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
kubelet |
authorino-5bfdbf97c8-7g9p8 |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
authorino-5bfdbf97c8 |
SuccessfulDelete |
Deleted pod: authorino-5bfdbf97c8-7g9p8 | |
opendatahub |
replicaset-controller |
llmisvc-controller-manager-6466c554d8 |
SuccessfulCreate |
Created pod: llmisvc-controller-manager-6466c554d8-cwlq7 | |
opendatahub |
deployment-controller |
llmisvc-controller-manager |
ScalingReplicaSet |
Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 | |
opendatahub |
multus |
llmisvc-controller-manager-6466c554d8-cwlq7 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-cwlq7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 388ms (388ms including waiting). Image size: 235100981 bytes. | |
opendatahub |
deployment-controller |
llmisvc-controller-manager |
ScalingReplicaSet |
Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 | |
opendatahub |
replicaset-controller |
llmisvc-controller-manager-869d5dcc5d |
SuccessfulDelete |
Deleted pod: llmisvc-controller-manager-869d5dcc5d-952vq | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-952vq |
Killing |
Stopping container manager | |
opendatahub |
replicaset-controller |
ai-gateway-controller-7d85675f98 |
SuccessfulCreate |
Created pod: ai-gateway-controller-7d85675f98-79cgw | |
opendatahub |
deployment-controller |
ai-gateway-controller |
ScalingReplicaSet |
Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1 | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-79cgw |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest" | |
opendatahub |
multus |
ai-gateway-controller-7d85675f98-79cgw |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-952vq |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.29:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-79cgw |
Created |
Container created | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-79cgw |
Started |
Container started | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-79cgw |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.579s (1.579s including waiting). Image size: 183888297 bytes. | |
opendatahub |
ai-gateway-controller-7d85675f98-79cgw_72ada33b-1705-45c7-b78d-1bc230d0034d |
ai-gateway-controller-leader.opendatahub.io |
LeaderElection |
ai-gateway-controller-7d85675f98-79cgw_72ada33b-1705-45c7-b78d-1bc230d0034d became leader | |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled up replica set payload-processing-5f78687d5b from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-7b98bb678c |
FailedCreate |
Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-5f78687d5b |
FailedCreate |
Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
openshift-ingress |
multus |
payload-pre-processing-7b98bb678c-xwtgm |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-xwtgm |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
replicaset-controller |
payload-processing-5f78687d5b |
SuccessfulCreate |
Created pod: payload-processing-5f78687d5b-2z78c | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-7b98bb678c |
SuccessfulCreate |
Created pod: payload-pre-processing-7b98bb678c-xwtgm | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-2z78c |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
multus |
payload-processing-5f78687d5b-2z78c |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-2z78c |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.15s (2.15s including waiting). Image size: 125317101 bytes. | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-2z78c |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-xwtgm |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-xwtgm |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-5f78687d5b-2z78c |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-xwtgm |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.276s (2.276s including waiting). Image size: 125317101 bytes. | |
opendatahub |
llmisvc-controller-manager-6466c554d8-cwlq7_f2be22f5-eee6-4c3a-a7e0-540fb632b0d7 |
llminferenceservice-kserve-controller-manager |
LeaderElection |
llmisvc-controller-manager-6466c554d8-cwlq7_f2be22f5-eee6-4c3a-a7e0-540fb632b0d7 became leader | |
opendatahub |
deployment-controller |
ai-gateway-controller |
ScalingReplicaSet |
Scaled up replica set ai-gateway-controller-685898bb78 from 0 to 1 | |
opendatahub |
replicaset-controller |
ai-gateway-controller-685898bb78 |
SuccessfulCreate |
Created pod: ai-gateway-controller-685898bb78-ztzsp | |
opendatahub |
kubelet |
ai-gateway-controller-685898bb78-ztzsp |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 374ms (374ms including waiting). Image size: 183888297 bytes. | |
opendatahub |
multus |
ai-gateway-controller-685898bb78-ztzsp |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
opendatahub |
kubelet |
ai-gateway-controller-685898bb78-ztzsp |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest" | |
opendatahub |
kubelet |
ai-gateway-controller-685898bb78-ztzsp |
Started |
Container started | |
opendatahub |
kubelet |
ai-gateway-controller-685898bb78-ztzsp |
Created |
Container created | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-79cgw |
Killing |
Stopping container manager | |
opendatahub |
deployment-controller |
ai-gateway-controller |
ScalingReplicaSet |
Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0 | |
opendatahub |
replicaset-controller |
ai-gateway-controller-7d85675f98 |
SuccessfulDelete |
Deleted pod: ai-gateway-controller-7d85675f98-79cgw | |
llm |
deployment-controller |
e2e-distinct-2-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.Deployment llm/e2e-distinct-2-simulated-kserve | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs | |
llm |
replicaset-controller |
e2e-distinct-2-simulated-kserve-cbd4f5586 |
SuccessfulCreate |
Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
multus |
e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 |
Started |
Container started | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.2s (1.2s including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-gh9v6 |
Created |
Container created | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs | |
llm |
replicaset-controller |
e2e-distinct-simulated-kserve-7b998b79d9 |
SuccessfulCreate |
Created pod: e2e-distinct-simulated-kserve-7b998b79d9-88f27 | |
llm |
multus |
e2e-distinct-simulated-kserve-7b998b79d9-88f27 |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
llm |
deployment-controller |
e2e-distinct-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.Deployment llm/e2e-distinct-simulated-kserve | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-88f27 |
Created |
Container created | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-88f27 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 228ms (228ms including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-88f27 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-88f27 |
Started |
Container started | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route | |
llm |
replicaset-controller |
e2e-embedding-simulated-kserve-67bf594cd6 |
SuccessfulCreate |
Created pod: e2e-embedding-simulated-kserve-67bf594cd6-2brd8 | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc | |
llm |
multus |
e2e-embedding-simulated-kserve-67bf594cd6-2brd8 |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-2brd8 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.Deployment llm/e2e-embedding-simulated-kserve | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs | |
llm |
deployment-controller |
e2e-embedding-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 | |
llm |
replicaset-controller |
e2e-trlp-test-simulated-kserve-69b588897d |
SuccessfulCreate |
Created pod: e2e-trlp-test-simulated-kserve-69b588897d-vfs8j | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-2brd8 |
Created |
Container created | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-2brd8 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.102s (1.102s including waiting). Image size: 98346788 bytes. | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.Deployment llm/e2e-trlp-test-simulated-kserve | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs | |
llm |
deployment-controller |
e2e-trlp-test-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping | |
llm |
multus |
e2e-trlp-test-simulated-kserve-69b588897d-vfs8j |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-vfs8j |
Started |
Container started | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-vfs8j |
Created |
Container created | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-vfs8j |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 203ms (203ms including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-vfs8j |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-2brd8 |
Started |
Container started | |
opendatahub |
ai-gateway-controller-685898bb78-ztzsp_71b43c90-0c20-40c8-ae02-f8c8e62a3b20 |
ai-gateway-controller-leader.opendatahub.io |
LeaderElection |
ai-gateway-controller-685898bb78-ztzsp_71b43c90-0c20-40c8-ae02-f8c8e62a3b20 became leader | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs | |
llm |
deployment-controller |
e2e-unconfigured-facebook-opt-125m-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c |
Started |
Container started | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c |
Created |
Container created | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 198ms (198ms including waiting). Image size: 98346788 bytes. | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve | |
llm |
multus |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c |
AddedInterface |
Add eth0 [10.133.0.44/23] from ovn-kubernetes | |
llm |
replicaset-controller |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc |
SuccessfulCreate |
Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmn5c | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.Secret llm/echo-simulator-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.Service llm/echo-simulator-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.HTTPRoute llm/echo-simulator-kserve-route | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.Deployment llm/echo-simulator-kserve | |
llm |
replicaset-controller |
echo-simulator-kserve-64b6f8f96c |
SuccessfulCreate |
Created pod: echo-simulator-kserve-64b6f8f96c-2s96l | |
llm |
deployment-controller |
echo-simulator-kserve |
ScalingReplicaSet |
Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1 | |
llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-2s96l |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" | |
llm |
multus |
echo-simulator-kserve-64b6f8f96c-2s96l |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.Deployment llm/facebook-opt-125m-simulated-kserve | |
llm |
multus |
facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route | |
llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-2s96l |
Created |
Container created | |
llm |
replicaset-controller |
facebook-opt-125m-simulated-kserve-84b4ff656c |
SuccessfulCreate |
Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m | |
llm |
deployment-controller |
facebook-opt-125m-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 | |
llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-2s96l |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.666s (1.666s including waiting). Image size: 78208878 bytes. | |
llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-2s96l |
Started |
Container started | |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m |
Started |
Container started | |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m |
Created |
Container created | |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-67k5m |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 213ms (213ms including waiting). Image size: 98346788 bytes. | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.Deployment llm/premium-simulated-simulated-premium-kserve | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs | |
llm |
deployment-controller |
premium-simulated-simulated-premium-kserve |
ScalingReplicaSet |
Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 | |
llm |
replicaset-controller |
premium-simulated-simulated-premium-kserve-5f5c4b459f |
SuccessfulCreate |
Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d |
Started |
Container started | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d |
Created |
Container created | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 193ms (193ms including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
multus |
premium-simulated-simulated-premium-kserve-5f5c4b459f-ggn5d |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-distinct-2-simulated] is Ready | |
| (x2) | llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Updated |
Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Updated |
Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 3; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-qmz72 | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-7854949c9 from 1 to 3 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-distinct-simulated] is Ready | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-gnw8g | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-embedding-simulated] is Ready | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Updated |
Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-trlp-test-simulated] is Ready | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Updated |
Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.714s (2.714s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.65s (2.65s including waiting). Image size: 183555333 bytes. | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Updated |
Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready | |
llm |
LLMInferenceServiceController |
echo-simulator |
Updated |
Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
echo-simulator |
LLMInferenceServiceReady |
LLMInferenceService [echo-simulator] is Ready | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
LLMInferenceServiceReady |
LLMInferenceService [facebook-opt-125m-simulated] is Ready | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Updated |
Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Updated |
Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Unhealthy |
Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
ProbeError |
Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
LLMInferenceServiceReady |
LLMInferenceService [premium-simulated-simulated-premium] is Ready | |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
ProbeError |
Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body: |
kuadrant-system |
replicaset-controller |
authorino-b79864c75 |
SuccessfulCreate |
Created pod: authorino-b79864c75-hs2nj | |
kuadrant-system |
multus |
authorino-b79864c75-hs2nj |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-b79864c75-hs2nj |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 653ms (653ms including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-b79864c75-hs2nj |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-b79864c75-hs2nj |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
kubelet |
authorino-b79864c75-hs2nj |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-68b69c6bbd-rhnpq |
Killing |
Stopping container authorino | |
| (x4) | kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
(combined from similar events): Scaled down replica set authorino-68b69c6bbd from 1 to 0 |
kuadrant-system |
replicaset-controller |
authorino-68b69c6bbd |
SuccessfulDelete |
Deleted pod: authorino-68b69c6bbd-rhnpq | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-rscbr |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-rscbr |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-566g7 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-rscbr | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-thwmn |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-thwmn | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-rscbr |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-rscbr |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
Started |
Container started | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 6; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-7854949c9 from 3 to 6 | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-566g7 |
AddedInterface |
Add eth0 [10.133.0.48/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
Started |
Container started | |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-rscbr |
Unhealthy |
Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
ProbeError |
Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-rscbr |
ProbeError |
Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
ProbeError |
Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
Unhealthy |
Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-8ncd4 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-44fbq |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-7854949c9 from 6 to 8 | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 8; reason: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-44fbq | |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
ProbeError |
Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
Unhealthy |
Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
ProbeError |
Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body: |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.DestinationRule llm/grid-inv-d36cd5af-model-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.PodMonitor llm/grid-inv-d36cd5af-model-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.HTTPRoute llm/grid-inv-d36cd5af-model-kserve-route | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.Service llm/grid-inv-d36cd5af-model-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.Deployment llm/grid-inv-d36cd5af-model-kserve | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.Secret llm/grid-inv-d36cd5af-model-kserve-self-signed-certs | |
llm |
deployment-controller |
grid-inv-d36cd5af-model-kserve |
ScalingReplicaSet |
Scaled up replica set grid-inv-d36cd5af-model-kserve-8cc86b6cd from 0 to 1 | |
llm |
replicaset-controller |
grid-inv-d36cd5af-model-kserve-8cc86b6cd |
SuccessfulCreate |
Created pod: grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg | |
llm |
kubelet |
grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg |
Created |
Container created | |
llm |
kubelet |
grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
kubelet |
grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg |
Started |
Container started | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.NetworkPolicy llm/grid-inv-d36cd5af-model-prometheus-scraping | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Created |
Created v1.PodMonitor llm/grid-inv-d36cd5af-model-kserve-llmisvc-engine | |
llm |
multus |
grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
ProbeError |
Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.Service llm/grid-inv-d36cd5af-unmatched-kserve-workload-svc | |
llm |
replicaset-controller |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd |
SuccessfulCreate |
Created pod: grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w | |
llm |
deployment-controller |
grid-inv-d36cd5af-unmatched-kserve |
ScalingReplicaSet |
Scaled up replica set grid-inv-d36cd5af-unmatched-kserve-b7b8745bd from 0 to 1 | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.Secret llm/grid-inv-d36cd5af-unmatched-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.Deployment llm/grid-inv-d36cd5af-unmatched-kserve | |
llm |
kubelet |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.NetworkPolicy llm/grid-inv-d36cd5af-unmatched-prometheus-scraping | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.PodMonitor llm/grid-inv-d36cd5af-unmatched-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.HTTPRoute llm/grid-inv-d36cd5af-unmatched-kserve-route | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.PodMonitor llm/grid-inv-d36cd5af-unmatched-kserve-llmisvc-engine-default | |
llm |
kubelet |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w |
Started |
Container started | |
llm |
kubelet |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w |
Created |
Container created | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Created |
Created v1.DestinationRule llm/grid-inv-d36cd5af-unmatched-kserve-workload-svc | |
llm |
multus |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
| (x2) | llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
Updated |
Updated v1.Secret llm/grid-inv-d36cd5af-model-kserve-self-signed-certs |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-w85rr |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-7854949c9-w85rr | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-7854949c9 from 8 to 10 | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-w85rr |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 10; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulCreate |
(combined from similar events): Created pod: maas-default-gateway-openshift-default-7854949c9-j8gnl | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
Updated |
Updated v1.Secret llm/grid-inv-d36cd5af-unmatched-kserve-self-signed-certs | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-w85rr |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-w85rr |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
ProbeError |
Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
Unhealthy |
Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-w85rr |
ProbeError |
Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-w85rr |
Unhealthy |
Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-model |
LLMInferenceServiceReady |
LLMInferenceService [grid-inv-d36cd5af-model] is Ready | |
llm |
LLMInferenceServiceController |
grid-inv-d36cd5af-unmatched |
LLMInferenceServiceReady |
LLMInferenceService [grid-inv-d36cd5af-unmatched] is Ready | |
llm |
kubelet |
grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg |
Killing |
Stopping container main | |
llm |
kubelet |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w |
Killing |
Stopping container main | |
llm |
kubelet |
grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c |
Created |
Container created | |
llm |
multus |
grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c |
AddedInterface |
Add eth0 [10.133.0.56/23] from ovn-kubernetes | |
llm |
kubelet |
grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.NetworkPolicy llm/grid-inv-337d7da1-model-prometheus-scraping | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.Secret llm/grid-inv-337d7da1-model-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.Deployment llm/grid-inv-337d7da1-model-kserve | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.PodMonitor llm/grid-inv-337d7da1-model-kserve-llmisvc-engine | |
llm |
kubelet |
grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c |
Started |
Container started | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.Service llm/grid-inv-337d7da1-model-kserve-workload-svc | |
llm |
replicaset-controller |
grid-inv-337d7da1-model-kserve-75c94ff67b |
SuccessfulCreate |
Created pod: grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c | |
llm |
deployment-controller |
grid-inv-337d7da1-model-kserve |
ScalingReplicaSet |
Scaled up replica set grid-inv-337d7da1-model-kserve-75c94ff67b from 0 to 1 | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.HTTPRoute llm/grid-inv-337d7da1-model-kserve-route | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.DestinationRule llm/grid-inv-337d7da1-model-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Created |
Created v1.PodMonitor llm/grid-inv-337d7da1-model-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.DestinationRule llm/grid-inv-337d7da1-unmatched-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.Service llm/grid-inv-337d7da1-unmatched-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.PodMonitor llm/grid-inv-337d7da1-unmatched-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.Secret llm/grid-inv-337d7da1-unmatched-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.NetworkPolicy llm/grid-inv-337d7da1-unmatched-prometheus-scraping | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.Deployment llm/grid-inv-337d7da1-unmatched-kserve | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.HTTPRoute llm/grid-inv-337d7da1-unmatched-kserve-route | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Created |
Created v1.PodMonitor llm/grid-inv-337d7da1-unmatched-kserve-llmisvc-engine-default | |
llm |
replicaset-controller |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646 |
SuccessfulCreate |
Created pod: grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 | |
llm |
deployment-controller |
grid-inv-337d7da1-unmatched-kserve |
ScalingReplicaSet |
Scaled up replica set grid-inv-337d7da1-unmatched-kserve-79ffcd7646 from 0 to 1 | |
llm |
multus |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
AddedInterface |
Add eth0 [10.133.0.57/23] from ovn-kubernetes | |
llm |
kubelet |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
kubelet |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
Created |
Container created | |
llm |
kubelet |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
Started |
Container started | |
llm |
kubelet |
grid-inv-d36cd5af-model-kserve-8cc86b6cd-d2fvg |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.51:8000/ready": dial tcp 10.132.0.51:8000: connect: connection refused | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
Updated |
Updated v1.Secret llm/grid-inv-337d7da1-model-kserve-self-signed-certs | |
llm |
kubelet |
grid-inv-d36cd5af-unmatched-kserve-b7b8745bd-f6r6w |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.52:8000/ready": EOF | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
Updated |
Updated v1.Secret llm/grid-inv-337d7da1-unmatched-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-model |
LLMInferenceServiceReady |
LLMInferenceService [grid-inv-337d7da1-model] is Ready | |
llm |
LLMInferenceServiceController |
grid-inv-337d7da1-unmatched |
LLMInferenceServiceReady |
LLMInferenceService [grid-inv-337d7da1-unmatched] is Ready | |
opendatahub |
kubelet |
test-curl-9119-8231d9 |
Pulling |
Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" | |
opendatahub |
multus |
test-curl-9119-8231d9 |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-9119-8231d9 |
Pulled |
Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.418s (2.418s including waiting). Image size: 106100986 bytes. | |
opendatahub |
kubelet |
test-curl-9119-8231d9 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-9119-8231d9 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-9119-340830 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-9119-8231d9 |
Killing |
Stopping container test-curl-9119-8231d9 | |
opendatahub |
multus |
test-curl-9119-340830 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-9119-340830 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-9119-340830 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-9119-6ad491 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-9119-340830 |
Killing |
Stopping container test-curl-9119-340830 | |
opendatahub |
kubelet |
test-curl-9119-6ad491 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-9119-6ad491 |
Started |
Container started | |
opendatahub |
multus |
test-curl-9119-6ad491 |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-9119-6ad491 |
Killing |
Stopping container test-curl-9119-6ad491 | |
openshift-ingress |
multus |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947 |
SuccessfulCreate |
Created pod: e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n | |
openshift-ingress |
deployment-controller |
e2e-shared-a-main-8d0914-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-main-8d0914-openshift-default-6bb45fd947 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-a-main-8d0914 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-main-8d0914 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-a-main-8d0914 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc9 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-a-main-8d0914 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-a-main-8d0914-785c597596 from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc9 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-8d0914: serviceaccount "payload-processing-e2e-shared-a-main-8d0914" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc9 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-main-8d0914-785c597596 |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-main-8d0914-785c597596 |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-a-main-8d0914-785c597596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-main-8d0914: serviceaccount "payload-processing-e2e-shared-a-main-8d0914" not found |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v |
Started |
Container started | |
openshift-ingress |
multus |
payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
Created |
Container created |
openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:33244->10.132.0.53:15021: read: connection reset by peer | |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
Started |
Container started |
openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
ProbeError |
Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:33244->10.132.0.53:15021: read: connection reset by peer body: | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-main-4dc002-openshift-default-d98b4775 |
SuccessfulCreate |
Created pod: e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c | |
openshift-ingress |
deployment-controller |
e2e-shared-b-main-4dc002-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-b-main-4dc002-openshift-default-d98b4775 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-b-main-4dc002 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-main-4dc002 | |
openshift-ingress |
multus |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
AddedInterface |
Add eth0 [10.132.0.57/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-b-main-4dc002 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-b-main-4dc002-57855bfc7b from 0 to 1 | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
Unhealthy |
Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
ProbeError |
Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body: |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-b-main-4dc002 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568c from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-4dc002: serviceaccount "payload-processing-e2e-shared-b-main-4dc002" not found |
openshift-ingress |
multus |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568c |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-main-4dc002: serviceaccount "payload-processing-e2e-shared-b-main-4dc002" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568c |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.034s (2.034s including waiting). Image size: 125317101 bytes. | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
ProbeError |
Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
Started |
Container started |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-main-8d0914-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-main-8d0914-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
Unhealthy |
Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
ProbeError |
Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-4dc002-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-4dc002-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-4dc002-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-main-4dc002-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
opendatahub |
kubelet |
test-curl-9119-9ee1e9 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
multus |
test-curl-9119-9ee1e9 |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-9119-9ee1e9 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-9119-9ee1e9 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-9119-9ee1e9 |
Killing |
Stopping container test-curl-9119-9ee1e9 | |
llm |
kubelet |
grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c |
Killing |
Stopping container main | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
ProbeError |
Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
llm |
kubelet |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
Killing |
Stopping container main | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-rscbr |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
ProbeError |
Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
ProbeError |
Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-rscbr |
ProbeError |
Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.DestinationRule llm/grid-inv-d6f7ff79-model-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.Service llm/grid-inv-d6f7ff79-model-kserve-workload-svc | |
llm |
deployment-controller |
grid-inv-d6f7ff79-model-kserve |
ScalingReplicaSet |
Scaled up replica set grid-inv-d6f7ff79-model-kserve-664c7fcfd7 from 0 to 1 | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.Deployment llm/grid-inv-d6f7ff79-model-kserve | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.HTTPRoute llm/grid-inv-d6f7ff79-model-kserve-route | |
llm |
replicaset-controller |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7 |
SuccessfulCreate |
Created pod: grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.Secret llm/grid-inv-d6f7ff79-model-kserve-self-signed-certs | |
llm |
multus |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
llm |
kubelet |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 |
Started |
Container started | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.PodMonitor llm/grid-inv-d6f7ff79-model-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.PodMonitor llm/grid-inv-d6f7ff79-model-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Created |
Created v1.NetworkPolicy llm/grid-inv-d6f7ff79-model-prometheus-scraping | |
llm |
kubelet |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
kubelet |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 |
Created |
Container created | |
llm |
replicaset-controller |
grid-inv-d6f7ff79-unmatched-kserve-b7956c777 |
SuccessfulCreate |
Created pod: grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.NetworkPolicy llm/grid-inv-d6f7ff79-unmatched-prometheus-scraping | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.Deployment llm/grid-inv-d6f7ff79-unmatched-kserve | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.Secret llm/grid-inv-d6f7ff79-unmatched-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.PodMonitor llm/grid-inv-d6f7ff79-unmatched-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.HTTPRoute llm/grid-inv-d6f7ff79-unmatched-kserve-route | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.DestinationRule llm/grid-inv-d6f7ff79-unmatched-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.PodMonitor llm/grid-inv-d6f7ff79-unmatched-kserve-llmisvc-engine-default | |
llm |
deployment-controller |
grid-inv-d6f7ff79-unmatched-kserve |
ScalingReplicaSet |
Scaled up replica set grid-inv-d6f7ff79-unmatched-kserve-b7956c777 from 0 to 1 | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Created |
Created v1.Service llm/grid-inv-d6f7ff79-unmatched-kserve-workload-svc | |
llm |
kubelet |
grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 |
Started |
Container started | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
Updated |
Updated v1.Secret llm/grid-inv-d6f7ff79-model-kserve-self-signed-certs | |
llm |
kubelet |
grid-inv-337d7da1-model-kserve-75c94ff67b-gg72c |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.56:8000/ready": EOF | |
llm |
multus |
grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 |
AddedInterface |
Add eth0 [10.133.0.64/23] from ovn-kubernetes | |
llm |
kubelet |
grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 |
Created |
Container created | |
llm |
kubelet |
grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
| (x6) | llm |
kubelet |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "grid-inv-337d7da1-unmatched-kserve-self-signed-certs" not found |
llm |
kubelet |
grid-inv-337d7da1-unmatched-kserve-79ffcd7646-jsdn7 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.57:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
Updated |
Updated v1.Secret llm/grid-inv-d6f7ff79-unmatched-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-model |
LLMInferenceServiceReady |
LLMInferenceService [grid-inv-d6f7ff79-model] is Ready | |
llm |
LLMInferenceServiceController |
grid-inv-d6f7ff79-unmatched |
LLMInferenceServiceReady |
LLMInferenceService [grid-inv-d6f7ff79-unmatched] is Ready | |
llm |
kubelet |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 |
Killing |
Stopping container main | |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
ProbeError |
Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
ProbeError |
Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
llm |
kubelet |
grid-inv-d6f7ff79-unmatched-kserve-b7956c777-d9g26 |
Killing |
Stopping container main | |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
ProbeError |
Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-main-8d0914-785c597596-cj59v |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-main-8d0914-7b8c5bdbc99vvs7 |
Killing |
Stopping container payload-pre-processing | |
llm |
kubelet |
grid-inv-d6f7ff79-model-kserve-664c7fcfd7-2qvj5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.46:8000/ready": dial tcp 10.134.0.46:8000: connect: connection refused | |
openshift-ingress |
kubelet |
e2e-shared-a-main-8d0914-openshift-default-6bb45fd947-vh76n |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-shared-b-main-4dc002-openshift-default-d98b4775-x594c |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-main-4dc002-57855bfc7b-l52p7 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-main-4dc002-5ff4cf568cxjq7d |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-566g7 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-gnw8g | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-fwvvf |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-7854949c9 from 10 to 3 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-fwvvf | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-w85rr | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-44fbq | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 3; reason: All metrics below target | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-566g7 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-j8gnl | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-qmz72 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-w85rr |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-44fbq |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-qmz72 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-j8gnl |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-gnw8g |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-8ncd4 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-8ncd4 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 2; reason: All metrics below target | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-7854949c9 from 3 to 2 | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-7854949c9 from 2 to 1 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-7854949c9 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-7854949c9-thwmn | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 1; reason: All metrics below target | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-7854949c9-thwmn |
Killing |
Stopping container istio-proxy | |
opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-cwlq7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 430ms (430ms including waiting). Image size: 235100981 bytes. | |
| (x2) | opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-cwlq7 |
Created |
Container created |
| (x2) | opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-cwlq7 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" |
| (x2) | opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-cwlq7 |
Started |
Container started |
opendatahub |
llmisvc-controller-manager-6466c554d8-cwlq7_4a63499b-8ae1-4158-b638-a5293112969d |
llminferenceservice-kserve-controller-manager |
LeaderElection |
llmisvc-controller-manager-6466c554d8-cwlq7_4a63499b-8ae1-4158-b638-a5293112969d became leader | |
| (x11) | llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
| (x11) | llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
| (x11) | llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
| (x12) | llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
| (x12) | llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
| (x12) | llm |
LLMInferenceServiceController |
echo-simulator |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
| (x12) | llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
| (x12) | llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Error |
Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "llminferenceservice.kserve-webhook-server.v1alpha2.defaulter": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service" |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
LLMInferenceServiceReady |
LLMInferenceService [premium-simulated-simulated-premium] is Ready | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-distinct-2-simulated] is Ready | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-distinct-simulated] is Ready | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-embedding-simulated] is Ready | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-trlp-test-simulated] is Ready | |
llm |
LLMInferenceServiceController |
echo-simulator |
LLMInferenceServiceReady |
LLMInferenceService [echo-simulator] is Ready | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
LLMInferenceServiceReady |
LLMInferenceService [facebook-opt-125m-simulated] is Ready |