| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds to ip-10-0-133-239.us-west-1.compute.internal | ||
ai-tenants |
e2e-autores-cf0095 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-cf0095: MaasTenantConfig is not available to restore revocation operands | ||
openshift-ingress |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
Scheduled |
Successfully assigned openshift-ingress/e2e-api-a-2e101a-openshift-default-88548686f-drm8q to ip-10-0-133-239.us-west-1.compute.internal | ||
ai-tenants |
e2e-extmod-a-6ac03f |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-6ac03f: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-extmod-b-3a78b4 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-3a78b4: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-inf-a-7bd72e |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-7bd72e: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-inf-b-036f88 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-036f88: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-ipp-a-1e6e34 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-1e6e34: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-ipp-b-193883 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-193883: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-mt-6a432197 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-6a432197: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-mt-8869c0de |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-8869c0de: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-praxis-b-966817 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-966817: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-shared-a-w4-dd087a |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-dd087a: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-shared-b-w4-03c4e8 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-03c4e8: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-worker-w0-b1703c |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-b1703c: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-worker-w3-4b9210 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-4b9210: MaasTenantConfig is not available to restore revocation operands | ||
cert-manager |
cert-manager-597b95cb84-vq24k |
Scheduled |
Successfully assigned cert-manager/cert-manager-597b95cb84-vq24k to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-547v7 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
kube-auth-proxy-85ccdd577f-llvhl |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-85ccdd577f-llvhl to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
kube-auth-proxy-85ccdd577f-4jv5l |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-85ccdd577f-4jv5l to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
router-default-567988bb57-rzsqv |
Scheduled |
Successfully assigned openshift-ingress/router-default-567988bb57-rzsqv to ip-10-0-135-24.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-599b76764c-tgzgs |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-599b76764c-tgzgs to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
router-default-567988bb57-rzsqv |
FailedScheduling |
no nodes available to schedule pods | ||
cert-manager |
cert-manager-cainjector-5c57bbd4fc-pm8v7 |
Scheduled |
Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-pm8v7 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
router-default-567988bb57-rzsqv |
FailedScheduling |
no nodes available to schedule pods | ||
models-as-a-service |
payload-processing-external-model-59f9b4bfb5-ww55q |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-59f9b4bfb5-ww55q to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
istiod-openshift-gateway-7ddd9cfdc8-s2tz8 |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-s2tz8 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-5cmc8 to ip-10-0-141-170.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-5bcd7997-x2xm2 |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-x2xm2 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh to ip-10-0-135-24.us-west-1.compute.internal | ||
cert-manager |
cert-manager-webhook-5dbbbf75cc-sqhjh |
Scheduled |
Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-sqhjh to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-r577d to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk to ip-10-0-135-24.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-5cc9844f6-pv7vm |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-5cc9844f6-pv7vm to ip-10-0-133-239.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-749cdcd88d-dm2dx |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-749cdcd88d-dm2dx to ip-10-0-133-239.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-7bc9c479f4-df544 |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-7bc9c479f4-df544 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq to ip-10-0-133-239.us-west-1.compute.internal | ||
llm |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Scheduled |
Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw to ip-10-0-135-24.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-7bc9c479f4-zpmgw |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-7bc9c479f4-zpmgw to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-lvhwz to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-l2zvm to ip-10-0-141-170.us-west-1.compute.internal | ||
kuadrant-system |
authorino-56c6c9ddd5-vn25l |
Scheduled |
Successfully assigned kuadrant-system/authorino-56c6c9ddd5-vn25l to ip-10-0-135-24.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-866d944846-nnbj2 |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-866d944846-nnbj2 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-bwld5 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-62g8c to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-lwhz4 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk to ip-10-0-135-24.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-978854467-vq6wf |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-978854467-vq6wf to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kj955 to ip-10-0-141-170.us-west-1.compute.internal | ||
kuadrant-system |
authorino-57f7f8659f-mhmp4 |
Scheduled |
Successfully assigned kuadrant-system/authorino-57f7f8659f-mhmp4 to ip-10-0-135-24.us-west-1.compute.internal | ||
opendatahub |
ai-gateway-controller-7d85675f98-2xzcb |
Scheduled |
Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-2xzcb to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
ai-gateway-controller-dcd84bcbc-k6pdq |
Scheduled |
Successfully assigned opendatahub/ai-gateway-controller-dcd84bcbc-k6pdq to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
kserve-controller-manager-776cc66d47-28669 |
Scheduled |
Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-28669 to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
kserve-module-controller-manager-7566cf5fc8-t5hm9 |
Scheduled |
Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-t5hm9 to ip-10-0-135-24.us-west-1.compute.internal | ||
opendatahub |
llmisvc-controller-manager-6466c554d8-vfxbz |
Scheduled |
Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-vfxbz to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
llmisvc-controller-manager-869d5dcc5d-lftbp |
Scheduled |
Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-lftbp to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
maas-controller-5975b94bc-2j9j5 |
Scheduled |
Successfully assigned opendatahub/maas-controller-5975b94bc-2j9j5 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx to ip-10-0-133-239.us-west-1.compute.internal | ||
kuadrant-system |
authorino-6f6944bcdd-pkkjq |
Scheduled |
Successfully assigned kuadrant-system/authorino-6f6944bcdd-pkkjq to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-58769f698d-9hnjj |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-58769f698d-9hnjj to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-62r9f to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-69b46c5574-d6tqb |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-69b46c5574-d6tqb to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-7b98bb678c-hf7lc |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-hf7lc to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 to ip-10-0-133-239.us-west-1.compute.internal | ||
kuadrant-system |
authorino-bc9d986f5-bqcdf |
Scheduled |
Successfully assigned kuadrant-system/authorino-bc9d986f5-bqcdf to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-7hsh2 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm to ip-10-0-135-24.us-west-1.compute.internal | ||
kuadrant-system |
authorino-c76cf7d7c-wlvz7 |
Scheduled |
Successfully assigned kuadrant-system/authorino-c76cf7d7c-wlvz7 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-7xbnw to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 to ip-10-0-133-239.us-west-1.compute.internal | ||
ai-tenants |
e2e-api-a-2e101a |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-2e101a: MaasTenantConfig is not available to restore revocation operands | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
maas-controller-5975b94bc-gwv4h |
Scheduled |
Successfully assigned opendatahub/maas-controller-5975b94bc-gwv4h to ip-10-0-133-239.us-west-1.compute.internal | ||
kuadrant-system |
authorino-fb96bcc76-d9wdp |
Scheduled |
Successfully assigned kuadrant-system/authorino-fb96bcc76-d9wdp to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-8gm95 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zkvl6 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zfkls to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp to ip-10-0-141-170.us-west-1.compute.internal | ||
kuadrant-system |
authorino-operator-7b7bb4bc77-wqxtt |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-wqxtt to ip-10-0-141-170.us-west-1.compute.internal | ||
llm |
facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh |
Scheduled |
Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh to ip-10-0-135-24.us-west-1.compute.internal | ||
opendatahub |
maas-controller-5975b94bc-pp42k |
Scheduled |
Successfully assigned opendatahub/maas-controller-5975b94bc-pp42k to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-z6h47 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
maas-controller-65f5678545-r9w4j |
Scheduled |
Successfully assigned opendatahub/maas-controller-65f5678545-r9w4j to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
model-serving-api-75bd89fdfc-7w4zh |
Scheduled |
Successfully assigned opendatahub/model-serving-api-75bd89fdfc-7w4zh to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
odh-model-controller-769875db56-6sbtx |
Scheduled |
Successfully assigned opendatahub/odh-model-controller-769875db56-6sbtx to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
test-curl-7221-219746 |
Scheduled |
Successfully assigned opendatahub/test-curl-7221-219746 to ip-10-0-135-24.us-west-1.compute.internal | ||
opendatahub |
test-curl-7221-dcee02 |
Scheduled |
Successfully assigned opendatahub/test-curl-7221-dcee02 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xvknm to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xhwwv to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wkxz9 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-8gqnt to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wktxt to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg to ip-10-0-141-170.us-west-1.compute.internal | ||
kuadrant-system |
dns-operator-controller-manager-8557cbdb84-56ffx |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-56ffx to ip-10-0-135-24.us-west-1.compute.internal | ||
opendatahub |
test-curl-7224-62bbdb |
Scheduled |
Successfully assigned opendatahub/test-curl-7224-62bbdb to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
test-curl-7224-6922d4 |
Scheduled |
Successfully assigned opendatahub/test-curl-7224-6922d4 to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
test-curl-7227-18ebed |
Scheduled |
Successfully assigned opendatahub/test-curl-7227-18ebed to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
test-curl-7227-2f49b6 |
Scheduled |
Successfully assigned opendatahub/test-curl-7227-2f49b6 to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
test-curl-7227-34e6b1 |
Scheduled |
Successfully assigned opendatahub/test-curl-7227-34e6b1 to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
test-curl-7227-634ce0 |
Scheduled |
Successfully assigned opendatahub/test-curl-7227-634ce0 to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
test-curl-7227-6891a7 |
Scheduled |
Successfully assigned opendatahub/test-curl-7227-6891a7 to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub |
test-curl-7227-77f79b |
Scheduled |
Successfully assigned opendatahub/test-curl-7227-77f79b to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-jthbv to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
test-curl-7227-97f775 |
Scheduled |
Successfully assigned opendatahub/test-curl-7227-97f775 to ip-10-0-141-170.us-west-1.compute.internal | ||
llm |
echo-simulator-kserve-64b6f8f96c-8bkgg |
Scheduled |
Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-8bkgg to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
Scheduled |
Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-4z4sj to ip-10-0-133-239.us-west-1.compute.internal | ||
opendatahub-operator-system |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Scheduled |
Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-9776d789f-fhjfh to ip-10-0-141-170.us-west-1.compute.internal | ||
opendatahub-operator-system |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Scheduled |
Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-9776d789f-fm4pv to ip-10-0-135-24.us-west-1.compute.internal | ||
llm |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q |
Scheduled |
Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q to ip-10-0-135-24.us-west-1.compute.internal | ||
kuadrant-system |
kuadrant-console-plugin-66c4fb575d-ck9gr |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-ck9gr to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 to ip-10-0-135-24.us-west-1.compute.internal | ||
ai-tenants |
e2e-explicit-6373b9 |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-6373b9: MaasTenantConfig is not available to restore revocation operands | ||
ai-tenants |
e2e-api-b-257e6d |
APIKeyCleanupSkipped |
Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-257e6d: MaasTenantConfig is not available to restore revocation operands | ||
openshift-ingress |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-th4ng to ip-10-0-141-170.us-west-1.compute.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-678d87766f-7wrsc |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7wrsc to ip-10-0-135-24.us-west-1.compute.internal | ||
opendatahub-operator-system |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Scheduled |
Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-9776d789f-nx47h to ip-10-0-133-239.us-west-1.compute.internal | ||
llm |
e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 |
Scheduled |
Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 to ip-10-0-135-24.us-west-1.compute.internal | ||
llm |
e2e-same-id-b-128a019f |
ModelNameConflictResolved |
Model identity is no longer shared with any other MaaSModelRef in this namespace | ||
llm |
e2e-same-id-b-128a019f |
ModelNameConflict |
Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-128a019f | ||
openshift-ingress |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-tbpd6 to ip-10-0-141-170.us-west-1.compute.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-678d87766f-bsm7c |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bsm7c to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-bp4h7 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d to ip-10-0-133-239.us-west-1.compute.internal | ||
kuadrant-system |
limitador-limitador-74dfcfb894-zw4g2 |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-zw4g2 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-t2z9c to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g to ip-10-0-133-239.us-west-1.compute.internal | ||
kuadrant-system |
limitador-limitador-7c9b87d574-v6wvs |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-v6wvs to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-t2q27 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cjqgb to ip-10-0-141-170.us-west-1.compute.internal | ||
kuadrant-system |
limitador-operator-controller-manager-5778bb4449-vktcs |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-vktcs to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l to ip-10-0-133-239.us-west-1.compute.internal | ||
models-as-a-service |
payload-processing-external-model-599b76764c-9xnbt |
Scheduled |
Successfully assigned models-as-a-service/payload-processing-external-model-599b76764c-9xnbt to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-jobset-operator |
jobset-controller-manager-7dcb89589c-48jk8 |
Scheduled |
Successfully assigned openshift-jobset-operator/jobset-controller-manager-7dcb89589c-48jk8 to ip-10-0-135-24.us-west-1.compute.internal | ||
llm |
e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c |
Scheduled |
Successfully assigned llm/e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c to ip-10-0-133-239.us-west-1.compute.internal | ||
llm |
e2e-same-id-a-128a019f |
ModelNameConflict |
Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-128a019f | ||
openshift-ingress |
data-science-gateway-data-science-gateway-class-7d699c9f7cnf28z |
Scheduled |
Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cnf28z to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
Scheduled |
Successfully assigned openshift-ingress/e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-jmqgd to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
Scheduled |
Successfully assigned openshift-ingress/e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
Scheduled |
Successfully assigned openshift-ingress/e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-jhwsm to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mc2nj to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-jobset-operator |
jobset-operator-674cd59dc5-bdzcv |
Scheduled |
Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-bdzcv to ip-10-0-141-170.us-west-1.compute.internal | ||
llm |
e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg |
Scheduled |
Successfully assigned llm/e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mg624 to ip-10-0-135-24.us-west-1.compute.internal | ||
llm |
e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 |
Scheduled |
Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
Scheduled |
Successfully assigned openshift-ingress/e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
Scheduled |
Successfully assigned openshift-ingress/e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-noten-02c1d2-openshift-default-84ff487789-gczvd |
Scheduled |
Successfully assigned openshift-ingress/e2e-noten-02c1d2-openshift-default-84ff487789-gczvd to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
Scheduled |
Successfully assigned openshift-ingress/e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cn28r to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-sn8dd to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-r8lg8 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
Scheduled |
Successfully assigned openshift-ingress/e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-r6j5r to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-r64l5 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-qzbzn to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
Scheduled |
Successfully assigned openshift-ingress/e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-ppqp4 to ip-10-0-133-239.us-west-1.compute.internal | ||
llm |
e2e-distinct-simulated-kserve-7b998b79d9-8j57g |
Scheduled |
Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-8j57g to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-pk25x to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-pjqbs to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnggl to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-nchmc to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Scheduled |
Successfully assigned openshift-ingress/e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
Scheduled |
Successfully assigned openshift-ingress/e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-55fbbbf9dc-z7qfl |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-z7qfl to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
Scheduled |
Successfully assigned openshift-ingress/e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
Scheduled |
Successfully assigned openshift-ingress/e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
Scheduled |
Successfully assigned openshift-ingress/e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
Scheduled |
Successfully assigned openshift-ingress/e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
Scheduled |
Successfully assigned openshift-ingress/e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd to ip-10-0-133-239.us-west-1.compute.internal | ||
llm |
e2e-embedding-simulated-kserve-67bf594cd6-r8qcw |
Scheduled |
Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-r8qcw to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-5d8fcd46d4-q24jg |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-5d8fcd46d4-q24jg to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-656dd59d89-ml7g4 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-656dd59d89-ml7g4 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-d9wv2 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mxp92 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
Scheduled |
Successfully assigned openshift-ingress/e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-ddhbn to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
Scheduled |
Successfully assigned openshift-ingress/e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
Scheduled |
Successfully assigned openshift-ingress/e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
Scheduled |
Successfully assigned openshift-ingress/e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-dghm7 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
Scheduled |
Successfully assigned openshift-ingress/e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mxd45 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx to ip-10-0-141-170.us-west-1.compute.internal | ||
llm |
e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn |
Scheduled |
Successfully assigned llm/e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-gt29z to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
Scheduled |
Successfully assigned openshift-ingress/e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
Scheduled |
Successfully assigned openshift-ingress/e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-api-b-257e6d-86977c947f-t9chn |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-api-b-257e6d-86977c947f-t9chn to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r to ip-10-0-133-239.us-west-1.compute.internal | ||
llm |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
Scheduled |
Successfully assigned llm/e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-ffnfw to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpqgm to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-gpkx2 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
Scheduled |
Successfully assigned openshift-ingress/e2e-derive-02304760-openshift-default-5f76687f89-s72l8 to ip-10-0-141-170.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
Scheduled |
Successfully assigned openshift-ingress/e2e-autores-cf0095-openshift-default-66557c8649-rjm2j to ip-10-0-133-239.us-west-1.compute.internal | ||
openshift-ingress |
payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
Scheduled |
Successfully assigned openshift-ingress/e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
Scheduled |
Successfully assigned openshift-ingress/e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 to ip-10-0-135-24.us-west-1.compute.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-567988bb57 from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
replicaset-controller |
router-default-567988bb57 |
SuccessfulCreate |
Created pod: router-default-567988bb57-rzsqv | |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
| (x5) | openshift-ingress |
kubelet |
router-default-567988bb57-rzsqv |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x5) | openshift-ingress |
kubelet |
router-default-567988bb57-rzsqv |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x4) | openshift-ingress |
kubelet |
router-default-567988bb57-rzsqv |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x5) | openshift-ingress |
kubelet |
router-default-567988bb57-rzsqv |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
openshift-ingress |
multus |
router-default-567988bb57-rzsqv |
AddedInterface |
Add eth0 [10.132.0.12/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-567988bb57-rzsqv |
Started |
Container started | |
openshift-ingress |
kubelet |
router-default-567988bb57-rzsqv |
Created |
Container created | |
openshift-ingress |
kubelet |
router-default-567988bb57-rzsqv |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod | |
openshift-ingress |
gateway_labeler_controller |
maas-default-gateway |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7876bfcb74 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7876bfcb74-bwld5 | |
openshift-ingress |
multus |
istiod-openshift-gateway-7876bfcb74-bwld5 |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Created |
Container created | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.612s (4.612s including waiting). Image size: 185476477 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Started |
Container started | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-ai-inference |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-mg624 | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-ai-inference-58fd47455f |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-ai-inference |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-ai-inference-58fd47455f from 0 to 1 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-ai-inference |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk |
Created |
Container created | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk |
Started |
Container started | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-ai-inference-58fd47455f-jc6wk |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.895s (8.895s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.238s (9.238s including waiting). Image size: 183555333 bytes. | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
RequirementsNotMet |
one or more requirements couldn't be found |
| (x2) | opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
RequirementsUnknown |
requirements not yet checked |
opendatahub-operator-system |
deployment-controller |
opendatahub-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set opendatahub-operator-controller-manager-9776d789f from 0 to 3 | |
opendatahub-operator-system |
replicaset-controller |
opendatahub-operator-controller-manager-9776d789f |
SuccessfulCreate |
Created pod: opendatahub-operator-controller-manager-9776d789f-nx47h | |
opendatahub-operator-system |
replicaset-controller |
opendatahub-operator-controller-manager-9776d789f |
SuccessfulCreate |
Created pod: opendatahub-operator-controller-manager-9776d789f-fm4pv | |
opendatahub-operator-system |
replicaset-controller |
opendatahub-operator-controller-manager-9776d789f |
SuccessfulCreate |
Created pod: opendatahub-operator-controller-manager-9776d789f-fhjfh | |
opendatahub-operator-system |
multus |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
opendatahub-operator-system |
multus |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
| (x2) | openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
RequirementsNotMet |
one or more requirements couldn't be found |
opendatahub-operator-system |
multus |
opendatahub-operator-controller-manager-9776d789f-nx47h |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
| (x2) | openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
RequirementsUnknown |
requirements not yet checked |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
NeedsReinstall |
calculated deployment install is bad | |
| (x2) | opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
InstallSucceeded |
waiting for install components to report healthy |
| (x2) | opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
AllRequirementsMet |
all requirements found, attempting install |
openshift-jobset-operator |
multus |
jobset-operator-674cd59dc5-bdzcv |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
opendatahub-operator-system |
operator-lifecycle-manager |
install-gq6kg |
AppliedWithWarnings |
1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1 | |
| (x2) | opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
InstallWaiting |
installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability. |
| (x2) | openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
InstallWaiting |
installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability. |
| (x2) | openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
InstallSucceeded |
waiting for install components to report healthy |
openshift-jobset-operator |
replicaset-controller |
jobset-operator-674cd59dc5 |
SuccessfulCreate |
Created pod: jobset-operator-674cd59dc5-bdzcv | |
openshift-jobset-operator |
deployment-controller |
jobset-operator |
ScalingReplicaSet |
Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1 | |
openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
AllRequirementsMet |
all requirements found, attempting install | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-bdzcv |
Pulling |
Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Created |
Container created | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Started |
Container started | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Started |
Container started | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.224s (3.224s including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.215s (3.215s including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.061s (4.061s including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Started |
Container started | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Pulling |
Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Started |
Container started | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-bdzcv |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Started |
Container started | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-bdzcv |
Started |
Container started | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 888ms (888ms including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-nx47h |
Created |
Container created | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fhjfh |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 851ms (851ms including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Started |
Container started | |
openshift-jobset-operator |
kubelet |
jobset-operator-674cd59dc5-bdzcv |
Pulled |
Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.635s (3.635s including waiting). Image size: 224874686 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Pulled |
Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 871ms (871ms including waiting). Image size: 273709574 bytes. | |
opendatahub-operator-system |
kubelet |
opendatahub-operator-controller-manager-9776d789f-fm4pv |
Created |
Container created | |
opendatahub-operator-system |
opendatahub-operator-controller-manager-9776d789f-fm4pv_3bb46062-c7cc-4b04-8f1c-7db85acce703 |
07ed84f7.opendatahub.io |
LeaderElection |
opendatahub-operator-controller-manager-9776d789f-fm4pv_3bb46062-c7cc-4b04-8f1c-7db85acce703 became leader | |
openshift-jobset-operator |
operator-lifecycle-manager |
jobset-operator.v1.0.1 |
InstallSucceeded |
install strategy completed with no errors | |
openshift-jobset-operator |
openshift-jobset-operator |
openshift-jobset-operator-lock |
LeaderElection |
jobset-operator-674cd59dc5-bdzcv_923032e9-87a2-43df-af8c-93ec3c08e7ed became leader | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
openshift-ai-inference-openshift-ai-inference |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-5778bb4449 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-5778bb4449-vktcs | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
limitador-operator-controller-manager-5778bb4449-vktcs |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-vktcs |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-vktcs |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 3.628s (3.628s including waiting). Image size: 177967631 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
limitador-operator-controller-manager-5778bb4449-vktcs_6b5c0394-8d92-4815-b247-1a0750f9b088 |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-5778bb4449-vktcs_6b5c0394-8d92-4815-b247-1a0750f9b088 became leader | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-8557cbdb84 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-8557cbdb84-56ffx | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-vktcs |
Started |
Container started | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-5778bb4449-vktcs |
Created |
Container created | |
kuadrant-system |
multus |
dns-operator-controller-manager-8557cbdb84-56ffx |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-56ffx |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-56ffx |
Started |
Container started | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-56ffx |
Created |
Container created | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-8557cbdb84-56ffx |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.513s (2.513s including waiting). Image size: 190804149 bytes. | |
opendatahub-operator-system |
operator-lifecycle-manager |
opendatahub-operator.v3.6.0-ea.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
dns-operator-controller-manager-8557cbdb84-56ffx_7e39c53f-466c-4dc7-9b4f-445765722f08 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-8557cbdb84-56ffx_7e39c53f-466c-4dc7-9b4f-445765722f08 became leader | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-678d87766f-7wrsc |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-678d87766f |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-678d87766f-7wrsc | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-7wrsc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
RequirementsUnknown |
requirements not yet checked | |
cert-manager |
deployment-controller |
cert-manager |
ScalingReplicaSet |
Scaled up replica set cert-manager-597b95cb84 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
RequirementsNotMet |
one or more requirements couldn't be found | |
cert-manager |
deployment-controller |
cert-manager-cainjector |
ScalingReplicaSet |
Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
| (x7) | cert-manager |
replicaset-controller |
cert-manager-cainjector-5c57bbd4fc |
FailedCreate |
Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found |
cert-manager |
replicaset-controller |
cert-manager-cainjector-5c57bbd4fc |
SuccessfulCreate |
Created pod: cert-manager-cainjector-5c57bbd4fc-pm8v7 | |
kuadrant-system |
replicaset-controller |
authorino-operator-7b7bb4bc77 |
SuccessfulCreate |
Created pod: authorino-operator-7b7bb4bc77-wqxtt | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1 | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-pm8v7 |
Pulling |
Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" | |
cert-manager |
multus |
cert-manager-cainjector-5c57bbd4fc-pm8v7 |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-wqxtt |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" | |
kuadrant-system |
multus |
authorino-operator-7b7bb4bc77-wqxtt |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-7wrsc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.632s (4.632s including waiting). Image size: 424244516 bytes. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-7wrsc |
Created |
Container created | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-7wrsc |
Started |
Container started | |
kuadrant-system |
kuadrant-operator-controller-manager-678d87766f-7wrsc_cad63f91-5ac0-4afc-87b8-66aea02addfc |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-678d87766f-7wrsc_cad63f91-5ac0-4afc-87b8-66aea02addfc became leader | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-wqxtt |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-wqxtt |
Created |
Container created | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-sqhjh |
Pulling |
Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" | |
cert-manager |
multus |
cert-manager-webhook-5dbbbf75cc-sqhjh |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-operator-7b7bb4bc77-wqxtt |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.764s (3.764s including waiting). Image size: 167738465 bytes. | |
cert-manager |
replicaset-controller |
cert-manager-webhook-5dbbbf75cc |
SuccessfulCreate |
Created pod: cert-manager-webhook-5dbbbf75cc-sqhjh | |
cert-manager |
deployment-controller |
cert-manager-webhook |
ScalingReplicaSet |
Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1 | |
kuadrant-system |
authorino-operator-7b7bb4bc77-wqxtt_94583e7a-02d3-4c44-9240-4a01e58d73f8 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-7b7bb4bc77-wqxtt_94583e7a-02d3-4c44-9240-4a01e58d73f8 became leader | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-pm8v7 |
Started |
Container started | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-pm8v7 |
Created |
Container created | |
cert-manager |
kubelet |
cert-manager-cainjector-5c57bbd4fc-pm8v7 |
Pulled |
Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.581s (4.581s including waiting). Image size: 309650901 bytes. | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1 | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-sqhjh |
Pulled |
Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 1.22s (1.22s including waiting). Image size: 309650901 bytes. | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-66c4fb575d |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-66c4fb575d-ck9gr | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-ck9gr |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-sqhjh |
Created |
Container created | |
cert-manager |
kubelet |
cert-manager-webhook-5dbbbf75cc-sqhjh |
Started |
Container started | |
kuadrant-system |
multus |
kuadrant-console-plugin-66c4fb575d-ck9gr |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
| (x12) | cert-manager |
replicaset-controller |
cert-manager-597b95cb84 |
FailedCreate |
Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ServiceAccountCreated |
Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ServiceCreated |
Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleCreated |
Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleCreated |
Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleCreated |
Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleBindingCreated |
Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleCreated |
Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleBindingCreated |
Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ClusterRoleBindingCreated |
Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing | |
| (x3) | openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
IssuerCreateFailed |
Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook" |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleCreated |
Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1 | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
ServiceCreated |
Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleBindingCreated |
Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-ck9gr |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-85ccdd577f |
SuccessfulCreate |
Created pod: kube-auth-proxy-85ccdd577f-4jv5l | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-ck9gr |
Created |
Container created | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-66c4fb575d-ck9gr |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.531s (5.531s including waiting). Image size: 342538866 bytes. | |
kuadrant-system |
replicaset-controller |
limitador-limitador-74dfcfb894 |
SuccessfulCreate |
Created pod: limitador-limitador-74dfcfb894-zw4g2 | |
kuadrant-system |
multus |
limitador-limitador-74dfcfb894-zw4g2 |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-zw4g2 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" | |
openshift-jobset-operator |
openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources |
jobset-operator |
RoleBindingCreated |
Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-85ccdd577f |
SuccessfulCreate |
Created pod: kube-auth-proxy-85ccdd577f-llvhl | |
openshift-ingress |
deployment-controller |
kube-auth-proxy |
ScalingReplicaSet |
Scaled up replica set kube-auth-proxy-85ccdd577f from 0 to 2 | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
CertificateCreated |
Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing | |
openshift-ingress |
multus |
kube-auth-proxy-85ccdd577f-4jv5l |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-llvhl |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" | |
openshift-ingress |
multus |
kube-auth-proxy-85ccdd577f-llvhl |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-57f7f8659f from 0 to 1 | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
CertificateCreated |
Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing | |
kuadrant-system |
replicaset-controller |
authorino-57f7f8659f |
SuccessfulCreate |
Created pod: authorino-57f7f8659f-mhmp4 | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
IssuerCreated |
Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing | |
openshift-ingress |
multus |
data-science-gateway-data-science-gateway-class-7d699c9f7cnf28z |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-7d699c9f7cnf28z |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-4jv5l |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" | |
openshift-ingress |
deployment-controller |
data-science-gateway-data-science-gateway-class |
ScalingReplicaSet |
Scaled up replica set data-science-gateway-data-science-gateway-class-7d699c9f7c from 0 to 1 | |
openshift-ingress |
replicaset-controller |
data-science-gateway-data-science-gateway-class-7d699c9f7c |
SuccessfulCreate |
Created pod: data-science-gateway-data-science-gateway-class-7d699c9f7cnf28z | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-7d699c9f7cnf28z |
Created |
Container created | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-7d699c9f7cnf28z |
Started |
Container started | |
kuadrant-system |
multus |
authorino-57f7f8659f-mhmp4 |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-mhmp4 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-zw4g2 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.667s (2.667s including waiting). Image size: 133379307 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-zw4g2 |
Started |
Container started | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-zw4g2 |
Created |
Container created | |
kuadrant-system |
replicaset-controller |
limitador-limitador-7c9b87d574 |
SuccessfulCreate |
Created pod: limitador-limitador-7c9b87d574-v6wvs | |
kuadrant-system |
replicaset-controller |
authorino-56c6c9ddd5 |
SuccessfulCreate |
Created pod: authorino-56c6c9ddd5-vn25l | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-4jv5l |
Started |
Container started | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-56c6c9ddd5 from 0 to 1 | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-4jv5l |
Created |
Container created | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-4jv5l |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.776s (2.776s including waiting). Image size: 188904677 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.3 |
InstallSucceeded |
install strategy completed with no errors | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-llvhl |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.812s (2.812s including waiting). Image size: 188904677 bytes. | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-llvhl |
Created |
Container created | |
openshift-ingress |
kubelet |
kube-auth-proxy-85ccdd577f-llvhl |
Started |
Container started | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1 | |
kuadrant-system |
multus |
authorino-56c6c9ddd5-vn25l |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-vn25l |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-v6wvs |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" | |
kuadrant-system |
multus |
limitador-limitador-7c9b87d574-v6wvs |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
cert-manager |
replicaset-controller |
cert-manager-597b95cb84 |
SuccessfulCreate |
Created pod: cert-manager-597b95cb84-vq24k | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-mhmp4 |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-vn25l |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-vn25l |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-vn25l |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.32s (2.32s including waiting). Image size: 204096810 bytes. | |
cert-manager |
kubelet |
cert-manager-597b95cb84-vq24k |
Pulled |
Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-mhmp4 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 4.843s (4.843s including waiting). Image size: 204096810 bytes. | |
cert-manager |
kubelet |
cert-manager-597b95cb84-vq24k |
Created |
Container created | |
cert-manager |
kubelet |
cert-manager-597b95cb84-vq24k |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-mhmp4 |
Started |
Container started | |
cert-manager |
multus |
cert-manager-597b95cb84-vq24k |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-57f7f8659f from 1 to 0 | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-v6wvs |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.89s (2.89s including waiting). Image size: 133379307 bytes. | |
kuadrant-system |
replicaset-controller |
authorino-57f7f8659f |
SuccessfulDelete |
Deleted pod: authorino-57f7f8659f-mhmp4 | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-v6wvs |
Started |
Container started | |
kuadrant-system |
kubelet |
limitador-limitador-7c9b87d574-v6wvs |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-57f7f8659f-mhmp4 |
Killing |
Stopping container authorino | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kuadrant-system |
kubelet |
limitador-limitador-74dfcfb894-zw4g2 |
Killing |
Stopping container limitador | |
kuadrant-system |
replicaset-controller |
limitador-limitador-74dfcfb894 |
SuccessfulDelete |
Deleted pod: limitador-limitador-74dfcfb894-zw4g2 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0 | |
opendatahub |
deployment-controller |
kserve-module-controller-manager |
ScalingReplicaSet |
Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1 | |
opendatahub |
replicaset-controller |
kserve-module-controller-manager-7566cf5fc8 |
SuccessfulCreate |
Created pod: kserve-module-controller-manager-7566cf5fc8-t5hm9 | |
opendatahub |
multus |
kserve-module-controller-manager-7566cf5fc8-t5hm9 |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-t5hm9 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-t5hm9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 4.363s (4.363s including waiting). Image size: 195729000 bytes. | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-t5hm9 |
Created |
Container created | |
openshift-jobset-operator |
cert-manager-certificates-trigger |
jobset-metrics-cert |
Issuing |
Issuing certificate as Secret does not exist | |
opendatahub |
kubelet |
kserve-module-controller-manager-7566cf5fc8-t5hm9 |
Started |
Container started | |
openshift-jobset-operator |
cert-manager-certificates-key-manager |
jobset-serving-cert |
Generated |
Stored new private key in temporary Secret resource "jobset-serving-cert-9fvs6" | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-acme |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-ca |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-approver |
jobset-metrics-cert-1 |
cert-manager.io |
Certificate request has been approved by cert-manager.io | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-metrics-cert-1 |
CertificateIssued |
Certificate fetched from issuer successfully | |
openshift-jobset-operator |
cert-manager-certificates-key-manager |
jobset-metrics-cert |
Generated |
Stored new private key in temporary Secret resource "jobset-metrics-cert-hl7cs" | |
openshift-jobset-operator |
cert-manager-certificates-request-manager |
jobset-metrics-cert |
Requested |
Created new CertificateRequest resource "jobset-metrics-cert-1" | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-acme |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-venafi |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-vault |
jobset-serving-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-venafi |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-approver |
jobset-serving-cert-1 |
cert-manager.io |
Certificate request has been approved by cert-manager.io | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-serving-cert-1 |
CertificateIssued |
Certificate fetched from issuer successfully | |
openshift-jobset-operator |
cert-manager-certificates-trigger |
jobset-serving-cert |
Issuing |
Issuing certificate as Secret does not exist | |
openshift-jobset-operator |
cert-manager-certificates-request-manager |
jobset-serving-cert |
Requested |
Created new CertificateRequest resource "jobset-serving-cert-1" | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-vault |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-ca |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
openshift-jobset-operator |
cert-manager-certificaterequests-issuer-selfsigned |
jobset-metrics-cert-1 |
WaitingForApproval |
Not signing CertificateRequest until it is Approved | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
data-science-gateway-data-science-gateway-class |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
data-science-gateway-data-science-gateway-class |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-jobset-operator |
cert-manager-certificates-issuing |
jobset-metrics-cert |
Issuing |
The certificate has been successfully issued | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
MutatingWebhookConfigurationCreated |
Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ValidatingWebhookConfigurationCreated |
Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing | |
openshift-jobset-operator |
cert-manager-certificates-issuing |
jobset-serving-cert |
Issuing |
The certificate has been successfully issued | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
RoleBindingCreated |
Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ServiceMonitorCreated |
Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
RoleCreated |
Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
CustomResourceDefinitionCreated |
Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
DeploymentCreated |
Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
MutatingWebhookConfigurationUpdated |
Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed | |
openshift-jobset-operator |
deployment-controller |
jobset-controller-manager |
ScalingReplicaSet |
Scaled up replica set jobset-controller-manager-7dcb89589c from 0 to 1 | |
openshift-jobset-operator |
replicaset-controller |
jobset-controller-manager-7dcb89589c |
SuccessfulCreate |
Created pod: jobset-controller-manager-7dcb89589c-48jk8 | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ConfigMapCreated |
Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing | |
openshift-jobset-operator |
openshift-jobset-operator |
jobset-operator |
ValidatingWebhookConfigurationUpdated |
Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed | |
openshift-jobset-operator |
multus |
jobset-controller-manager-7dcb89589c-48jk8 |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-7dcb89589c-48jk8 |
Pulling |
Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-7dcb89589c-48jk8 |
Pulled |
Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.879s (3.879s including waiting). Image size: 182184678 bytes. | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-7dcb89589c-48jk8 |
Created |
Container created | |
openshift-jobset-operator |
kubelet |
jobset-controller-manager-7dcb89589c-48jk8 |
Started |
Container started | |
openshift-jobset-operator |
jobset-controller-manager-7dcb89589c-48jk8_e457f8cd-bb90-43d0-8535-1e378bc923c7 |
6d4f6a47.jobset.x-k8s.io |
LeaderElection |
jobset-controller-manager-7dcb89589c-48jk8_e457f8cd-bb90-43d0-8535-1e378bc923c7 became leader | |
opendatahub |
replicaset-controller |
maas-controller-65f5678545 |
SuccessfulCreate |
Created pod: maas-controller-65f5678545-r9w4j | |
opendatahub |
deployment-controller |
maas-controller |
ScalingReplicaSet |
Scaled up replica set maas-controller-65f5678545 from 0 to 1 | |
opendatahub |
multus |
maas-controller-5975b94bc-pp42k |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
opendatahub |
replicaset-controller |
maas-controller-5975b94bc |
SuccessfulCreate |
Created pod: maas-controller-5975b94bc-pp42k | |
opendatahub |
kubelet |
maas-controller-65f5678545-r9w4j |
FailedMount |
MountVolume.SetUp failed for volume "webhook-cert" : secret "maas-controller-webhook-cert" not found | |
opendatahub |
multus |
maas-controller-65f5678545-r9w4j |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
opendatahub |
kserve-module-controller-manager-7566cf5fc8-t5hm9_5b572bbe-76e5-465d-bb82-1df6f91516d2 |
kserve-module-controller-manager |
LeaderElection |
kserve-module-controller-manager-7566cf5fc8-t5hm9_5b572bbe-76e5-465d-bb82-1df6f91516d2 became leader | |
opendatahub |
kubelet |
maas-controller-65f5678545-r9w4j |
Pulling |
Pulling image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" | |
opendatahub |
kubelet |
maas-controller-65f5678545-r9w4j |
Created |
Container created | |
opendatahub |
kubelet |
maas-controller-65f5678545-r9w4j |
Pulled |
Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" in 6.335s (6.335s including waiting). Image size: 200094741 bytes. | |
opendatahub |
kubelet |
maas-controller-65f5678545-r9w4j |
Started |
Container started | |
opendatahub |
kubelet |
maas-controller-5975b94bc-pp42k |
Pulled |
Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" in 6.383s (6.383s including waiting). Image size: 200094741 bytes. | |
opendatahub |
maas-controller-65f5678545-r9w4j_01c7c3ee-ddfe-4cb8-88c1-70bdc8de9eac |
maas-controller.models-as-a-service.opendatahub.io |
LeaderElection |
maas-controller-65f5678545-r9w4j_01c7c3ee-ddfe-4cb8-88c1-70bdc8de9eac became leader | |
opendatahub |
deployment-controller |
usage-logs-tenancy-proxy |
ScalingReplicaSet |
Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1 | |
opendatahub |
replicaset-controller |
usage-logs-tenancy-proxy-9c5d49bcd |
SuccessfulCreate |
Created pod: usage-logs-tenancy-proxy-9c5d49bcd-4z4sj | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
FailedMount |
MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
FailedMount |
MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
Pulling |
Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" | |
opendatahub |
multus |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
opendatahub |
kubelet |
maas-controller-65f5678545-r9w4j |
Killing |
Stopping container manager | |
opendatahub |
deployment-controller |
maas-controller |
ScalingReplicaSet |
Scaled down replica set maas-controller-65f5678545 from 1 to 0 | |
opendatahub |
replicaset-controller |
maas-controller-65f5678545 |
SuccessfulDelete |
Deleted pod: maas-controller-65f5678545-r9w4j | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
Pulled |
Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 12.617s (12.617s including waiting). Image size: 1089502687 bytes. | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
Created |
Container created | |
opendatahub |
kubelet |
usage-logs-tenancy-proxy-9c5d49bcd-4z4sj |
Started |
Container started | |
opendatahub |
maas-controller-5975b94bc-pp42k_882afe8e-4eb6-45f9-8c1e-07d515481750 |
maas-controller.models-as-a-service.opendatahub.io |
LeaderElection |
maas-controller-5975b94bc-pp42k_882afe8e-4eb6-45f9-8c1e-07d515481750 became leader | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7ddd9cfdc8 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7ddd9cfdc8-s2tz8 | |
openshift-ingress |
multus |
istiod-openshift-gateway-7ddd9cfdc8-s2tz8 |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-s2tz8 |
Created |
Container created | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-s2tz8 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-s2tz8 |
Started |
Container started | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-s2tz8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-s2tz8 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7876bfcb74 |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7876bfcb74-bwld5 | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Killing |
Stopping container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
ProbeError |
Readiness probe error: Get "http://10.133.0.21:8080/ready": dial tcp 10.133.0.21:8080: connect: connection refused body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7876bfcb74-bwld5 |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.21:8080/ready": dial tcp 10.133.0.21:8080: connect: connection refused | |
opendatahub |
replicaset-controller |
odh-model-controller-769875db56 |
SuccessfulCreate |
Created pod: odh-model-controller-769875db56-6sbtx | |
opendatahub |
deployment-controller |
llmisvc-controller-manager |
ScalingReplicaSet |
Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1 | |
opendatahub |
deployment-controller |
kserve-controller-manager |
ScalingReplicaSet |
Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1 | |
opendatahub |
deployment-controller |
odh-model-controller |
ScalingReplicaSet |
Scaled up replica set odh-model-controller-769875db56 from 0 to 1 | |
opendatahub |
replicaset-controller |
llmisvc-controller-manager-869d5dcc5d |
SuccessfulCreate |
Created pod: llmisvc-controller-manager-869d5dcc5d-lftbp | |
opendatahub |
replicaset-controller |
model-serving-api-75bd89fdfc |
SuccessfulCreate |
Created pod: model-serving-api-75bd89fdfc-7w4zh | |
opendatahub |
deployment-controller |
model-serving-api |
ScalingReplicaSet |
Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1 | |
opendatahub |
multus |
kserve-controller-manager-776cc66d47-28669 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
opendatahub |
replicaset-controller |
kserve-controller-manager-776cc66d47 |
SuccessfulCreate |
Created pod: kserve-controller-manager-776cc66d47-28669 | |
opendatahub |
kubelet |
odh-model-controller-769875db56-6sbtx |
Pulling |
Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" | |
opendatahub |
multus |
llmisvc-controller-manager-869d5dcc5d-lftbp |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-28669 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-lftbp |
Pulling |
Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" | |
opendatahub |
multus |
odh-model-controller-769875db56-6sbtx |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
opendatahub |
multus |
model-serving-api-75bd89fdfc-7w4zh |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-7w4zh |
Pulling |
Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-7w4zh |
Created |
Container created | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-7w4zh |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.184s (2.184s including waiting). Image size: 184925761 bytes. | |
opendatahub |
kubelet |
model-serving-api-75bd89fdfc-7w4zh |
Started |
Container started | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-lftbp |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.388s (2.388s including waiting). Image size: 235100981 bytes. | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-lftbp |
Started |
Container started | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-lftbp |
Created |
Container created | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-28669 |
Started |
Container started | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-28669 |
Created |
Container created | |
opendatahub |
kubelet |
kserve-controller-manager-776cc66d47-28669 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.455s (2.455s including waiting). Image size: 247676581 bytes. | |
opendatahub |
kubelet |
odh-model-controller-769875db56-6sbtx |
Started |
Container started | |
opendatahub |
kserve-controller-manager-776cc66d47-28669_e8ff832b-ba3a-409a-a983-f6448c007640 |
kserve-controller-manager-leader-lock |
LeaderElection |
kserve-controller-manager-776cc66d47-28669_e8ff832b-ba3a-409a-a983-f6448c007640 became leader | |
opendatahub |
kubelet |
odh-model-controller-769875db56-6sbtx |
Created |
Container created | |
opendatahub |
kubelet |
odh-model-controller-769875db56-6sbtx |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.087s (3.087s including waiting). Image size: 236755567 bytes. | |
opendatahub |
odh-model-controller-769875db56-6sbtx_e8e4811b-b906-4c82-a848-f1e8f1442ac8 |
odh-model-controller.opendatahub.io |
LeaderElection |
odh-model-controller-769875db56-6sbtx_e8e4811b-b906-4c82-a848-f1e8f1442ac8 became leader | |
opendatahub |
llmisvc-controller-manager-869d5dcc5d-lftbp_7e862f2e-b033-4572-a816-465798f3a2fe |
llminferenceservice-kserve-controller-manager |
LeaderElection |
llmisvc-controller-manager-869d5dcc5d-lftbp_7e862f2e-b033-4572-a816-465798f3a2fe became leader | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
ProbeError |
Readiness probe error: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Created |
Container created |
kuadrant-system |
replicaset-controller |
authorino-6f6944bcdd |
SuccessfulCreate |
Created pod: authorino-6f6944bcdd-pkkjq | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-6f6944bcdd from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-c76cf7d7c |
SuccessfulCreate |
Created pod: authorino-c76cf7d7c-wlvz7 | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-pkkjq |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
multus |
authorino-c76cf7d7c-wlvz7 |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-bc9d986f5 from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-c76cf7d7c from 1 to 0 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-6f6944bcdd from 1 to 0 | |
kuadrant-system |
replicaset-controller |
authorino-bc9d986f5 |
SuccessfulCreate |
Created pod: authorino-bc9d986f5-bqcdf | |
kuadrant-system |
replicaset-controller |
authorino-6f6944bcdd |
SuccessfulDelete |
Deleted pod: authorino-6f6944bcdd-pkkjq | |
kuadrant-system |
replicaset-controller |
authorino-c76cf7d7c |
SuccessfulDelete |
Deleted pod: authorino-c76cf7d7c-wlvz7 | |
kuadrant-system |
kubelet |
authorino-c76cf7d7c-wlvz7 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-c76cf7d7c from 0 to 1 | |
kuadrant-system |
multus |
authorino-6f6944bcdd-pkkjq |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused |
kuadrant-system |
kubelet |
authorino-bc9d986f5-bqcdf |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
ProbeError |
Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body: |
kuadrant-system |
multus |
authorino-bc9d986f5-bqcdf |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-bc9d986f5-bqcdf |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-c76cf7d7c-wlvz7 |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-c76cf7d7c-wlvz7 |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-c76cf7d7c-wlvz7 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.218s (1.218s including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-bc9d986f5-bqcdf |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-bc9d986f5-bqcdf |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.231s (1.231s including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-pkkjq |
Started |
Container started | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-pkkjq |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-pkkjq |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.54s (1.54s including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-c76cf7d7c-wlvz7 |
Killing |
Stopping container authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-56c6c9ddd5 from 1 to 0 | |
kuadrant-system |
replicaset-controller |
authorino-56c6c9ddd5 |
SuccessfulDelete |
Deleted pod: authorino-56c6c9ddd5-vn25l | |
kuadrant-system |
kubelet |
authorino-6f6944bcdd-pkkjq |
Killing |
Stopping container authorino | |
kuadrant-system |
kubelet |
authorino-56c6c9ddd5-vn25l |
Killing |
Stopping container authorino | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
opendatahub |
deployment-controller |
llmisvc-controller-manager |
ScalingReplicaSet |
Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1 | |
opendatahub |
replicaset-controller |
llmisvc-controller-manager-6466c554d8 |
SuccessfulCreate |
Created pod: llmisvc-controller-manager-6466c554d8-vfxbz | |
opendatahub |
multus |
llmisvc-controller-manager-6466c554d8-vfxbz |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-vfxbz |
Pulling |
Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" | |
opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-vfxbz |
Started |
Container started | |
opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-vfxbz |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 782ms (782ms including waiting). Image size: 235100981 bytes. | |
opendatahub |
kubelet |
llmisvc-controller-manager-6466c554d8-vfxbz |
Created |
Container created | |
opendatahub |
kubelet |
llmisvc-controller-manager-869d5dcc5d-lftbp |
Killing |
Stopping container manager | |
opendatahub |
deployment-controller |
llmisvc-controller-manager |
ScalingReplicaSet |
Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0 | |
opendatahub |
replicaset-controller |
llmisvc-controller-manager-869d5dcc5d |
SuccessfulDelete |
Deleted pod: llmisvc-controller-manager-869d5dcc5d-lftbp | |
opendatahub |
kubelet |
maas-controller-5975b94bc-pp42k |
Pulled |
Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" in 869ms (869ms including waiting). Image size: 200094741 bytes. | |
| (x2) | opendatahub |
kubelet |
maas-controller-5975b94bc-pp42k |
Pulling |
Pulling image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" |
| (x2) | opendatahub |
kubelet |
maas-controller-5975b94bc-pp42k |
Created |
Container created |
| (x2) | opendatahub |
kubelet |
maas-controller-5975b94bc-pp42k |
Started |
Container started |
opendatahub |
replicaset-controller |
ai-gateway-controller-7d85675f98 |
SuccessfulCreate |
Created pod: ai-gateway-controller-7d85675f98-2xzcb | |
opendatahub |
deployment-controller |
ai-gateway-controller |
ScalingReplicaSet |
Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1 | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-2xzcb |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest" | |
opendatahub |
multus |
ai-gateway-controller-7d85675f98-2xzcb |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-2xzcb |
Started |
Container started | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-2xzcb |
Created |
Container created | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-2xzcb |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 3.008s (3.008s including waiting). Image size: 183979434 bytes. | |
opendatahub |
ai-gateway-controller-7d85675f98-2xzcb_421e3df6-8437-43cf-b598-09137a959348 |
ai-gateway-controller-leader.opendatahub.io |
LeaderElection |
ai-gateway-controller-7d85675f98-2xzcb_421e3df6-8437-43cf-b598-09137a959348 became leader | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-7b98bb678c |
FailedCreate |
Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-55fbbbf9dc |
FailedCreate |
Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
openshift-ingress |
replicaset-controller |
payload-processing-55fbbbf9dc |
SuccessfulCreate |
Created pod: payload-processing-55fbbbf9dc-z7qfl | |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-7b98bb678c |
SuccessfulCreate |
Created pod: payload-pre-processing-7b98bb678c-hf7lc | |
openshift-ingress |
multus |
payload-processing-55fbbbf9dc-z7qfl |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-pre-processing-7b98bb678c-hf7lc |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-55fbbbf9dc-z7qfl |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-hf7lc |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
kubelet |
payload-processing-55fbbbf9dc-z7qfl |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-55fbbbf9dc-z7qfl |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-55fbbbf9dc-z7qfl |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.664s (2.664s including waiting). Image size: 125353963 bytes. | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-hf7lc |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.739s (2.739s including waiting). Image size: 125353963 bytes. | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-hf7lc |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-hf7lc |
Started |
Container started | |
opendatahub |
llmisvc-controller-manager-6466c554d8-vfxbz_0fdc9763-f584-482e-878e-c53efc7ed164 |
llminferenceservice-kserve-controller-manager |
LeaderElection |
llmisvc-controller-manager-6466c554d8-vfxbz_0fdc9763-f584-482e-878e-c53efc7ed164 became leader | |
opendatahub |
deployment-controller |
ai-gateway-controller |
ScalingReplicaSet |
Scaled up replica set ai-gateway-controller-dcd84bcbc from 0 to 1 | |
opendatahub |
multus |
ai-gateway-controller-dcd84bcbc-k6pdq |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
opendatahub |
replicaset-controller |
ai-gateway-controller-dcd84bcbc |
SuccessfulCreate |
Created pod: ai-gateway-controller-dcd84bcbc-k6pdq | |
opendatahub |
kubelet |
ai-gateway-controller-dcd84bcbc-k6pdq |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest" | |
opendatahub |
kubelet |
ai-gateway-controller-dcd84bcbc-k6pdq |
Created |
Container created | |
opendatahub |
kubelet |
ai-gateway-controller-dcd84bcbc-k6pdq |
Started |
Container started | |
opendatahub |
kubelet |
ai-gateway-controller-dcd84bcbc-k6pdq |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 774ms (775ms including waiting). Image size: 183979434 bytes. | |
opendatahub |
maas-controller-5975b94bc-pp42k_0e989b70-963e-4352-8d9d-687fcbf76ab7 |
maas-controller.models-as-a-service.opendatahub.io |
LeaderElection |
maas-controller-5975b94bc-pp42k_0e989b70-963e-4352-8d9d-687fcbf76ab7 became leader | |
opendatahub |
deployment-controller |
ai-gateway-controller |
ScalingReplicaSet |
Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0 | |
opendatahub |
replicaset-controller |
ai-gateway-controller-7d85675f98 |
SuccessfulDelete |
Deleted pod: ai-gateway-controller-7d85675f98-2xzcb | |
opendatahub |
kubelet |
ai-gateway-controller-7d85675f98-2xzcb |
Killing |
Stopping container manager | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs | |
llm |
replicaset-controller |
e2e-distinct-2-simulated-kserve-cbd4f5586 |
SuccessfulCreate |
Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.Deployment llm/e2e-distinct-2-simulated-kserve | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc | |
llm |
deployment-controller |
e2e-distinct-2-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping | |
llm |
multus |
e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 |
Created |
Container created | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 |
Started |
Container started | |
llm |
kubelet |
e2e-distinct-2-simulated-kserve-cbd4f5586-4l7p7 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.07s (2.07s including waiting). Image size: 98346788 bytes. | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default | |
llm |
replicaset-controller |
e2e-distinct-simulated-kserve-7b998b79d9 |
SuccessfulCreate |
Created pod: e2e-distinct-simulated-kserve-7b998b79d9-8j57g | |
llm |
deployment-controller |
e2e-distinct-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.Deployment llm/e2e-distinct-simulated-kserve | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-8j57g |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 581ms (581ms including waiting). Image size: 98346788 bytes. | |
llm |
multus |
e2e-distinct-simulated-kserve-7b998b79d9-8j57g |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-8j57g |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping | |
opendatahub |
ai-gateway-controller-dcd84bcbc-k6pdq_ed9c27ed-6973-415b-8f02-f40e4d5f408c |
ai-gateway-controller-leader.opendatahub.io |
LeaderElection |
ai-gateway-controller-dcd84bcbc-k6pdq_ed9c27ed-6973-415b-8f02-f40e4d5f408c became leader | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-8j57g |
Created |
Container created | |
llm |
kubelet |
e2e-distinct-simulated-kserve-7b998b79d9-8j57g |
Started |
Container started | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Created |
Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.Deployment llm/e2e-embedding-simulated-kserve | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route | |
llm |
multus |
e2e-embedding-simulated-kserve-67bf594cd6-r8qcw |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc | |
llm |
deployment-controller |
e2e-embedding-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-r8qcw |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
replicaset-controller |
e2e-embedding-simulated-kserve-67bf594cd6 |
SuccessfulCreate |
Created pod: e2e-embedding-simulated-kserve-67bf594cd6-r8qcw | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-r8qcw |
Created |
Container created | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-r8qcw |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 589ms (589ms including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
e2e-embedding-simulated-kserve-67bf594cd6-r8qcw |
Started |
Container started | |
llm |
deployment-controller |
e2e-trlp-test-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs | |
llm |
replicaset-controller |
e2e-trlp-test-simulated-kserve-69b588897d |
SuccessfulCreate |
Created pod: e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.Deployment llm/e2e-trlp-test-simulated-kserve | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route | |
llm |
multus |
e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.507s (1.507s including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 |
Created |
Container created | |
llm |
kubelet |
e2e-trlp-test-simulated-kserve-69b588897d-2hcp9 |
Started |
Container started | |
llm |
deployment-controller |
e2e-unconfigured-facebook-opt-125m-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve | |
llm |
replicaset-controller |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc |
SuccessfulCreate |
Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Created |
Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping | |
llm |
multus |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q |
Created |
Container created | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q |
Started |
Container started | |
llm |
kubelet |
e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8k5m6q |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 604ms (604ms including waiting). Image size: 98346788 bytes. | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.Secret llm/echo-simulator-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.HTTPRoute llm/echo-simulator-kserve-route | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.Service llm/echo-simulator-kserve-workload-svc | |
llm |
multus |
echo-simulator-kserve-64b6f8f96c-8bkgg |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.Deployment llm/echo-simulator-kserve | |
llm |
deployment-controller |
echo-simulator-kserve |
ScalingReplicaSet |
Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1 | |
llm |
replicaset-controller |
echo-simulator-kserve-64b6f8f96c |
SuccessfulCreate |
Created pod: echo-simulator-kserve-64b6f8f96c-8bkgg | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 1 to 3 | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-ddhbn | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping | |
llm |
LLMInferenceServiceController |
echo-simulator |
Created |
Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-cjqgb | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs | |
llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-8bkgg |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.571s (2.571s including waiting). Image size: 78208878 bytes. | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.Deployment llm/facebook-opt-125m-simulated-kserve | |
llm |
deployment-controller |
facebook-opt-125m-simulated-kserve |
ScalingReplicaSet |
Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 | |
llm |
replicaset-controller |
facebook-opt-125m-simulated-kserve-84b4ff656c |
SuccessfulCreate |
Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc | |
| (x2) | llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-8bkgg |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine | |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route | |
llm |
multus |
facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.616s (3.616s including waiting). Image size: 183555333 bytes. | |
| (x2) | llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-8bkgg |
Created |
Container created |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh |
Started |
Container started | |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh |
Created |
Container created | |
| (x2) | llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-8bkgg |
Started |
Container started |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Created |
Container created | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Created |
Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping | |
llm |
kubelet |
facebook-opt-125m-simulated-kserve-84b4ff656c-mghxh |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 567ms (567ms including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
echo-simulator-kserve-64b6f8f96c-8bkgg |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 616ms (616ms including waiting). Image size: 78208878 bytes. | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.861s (3.862s including waiting). Image size: 183555333 bytes. | |
llm |
deployment-controller |
premium-simulated-simulated-premium-kserve |
ScalingReplicaSet |
Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.Deployment llm/premium-simulated-simulated-premium-kserve | |
llm |
replicaset-controller |
premium-simulated-simulated-premium-kserve-5f5c4b459f |
SuccessfulCreate |
Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 588ms (588ms including waiting). Image size: 98346788 bytes. | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
llm |
multus |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Created |
Container created | |
llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Started |
Container started | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Created |
Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default | |
| (x2) | llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
Updated |
Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
ProbeError |
Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
ProbeError |
Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Unhealthy |
Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused |
llm |
LLMInferenceServiceController |
e2e-distinct-2-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-distinct-2-simulated] is Ready | |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Unhealthy |
Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
ProbeError |
Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
Updated |
Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
ProbeError |
Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Unhealthy |
Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Unhealthy |
Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-zkvl6 | |
llm |
LLMInferenceServiceController |
e2e-distinct-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-distinct-simulated] is Ready | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-mxp92 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-th4ng | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
AddedInterface |
Add eth0 [10.133.0.40/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
Created |
Container created | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
Updated |
Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-embedding-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-embedding-simulated] is Ready | |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
Updated |
Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
ProbeError |
Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused |
llm |
LLMInferenceServiceController |
e2e-trlp-test-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-trlp-test-simulated] is Ready | |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
ProbeError |
Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
Unhealthy |
Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
Updated |
Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
ProbeError |
Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body: |
llm |
LLMInferenceServiceController |
e2e-unconfigured-facebook-opt-125m-simulated |
LLMInferenceServiceReady |
LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready | |
llm |
LLMInferenceServiceController |
echo-simulator |
Updated |
Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-sn8dd | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 6 to 7 | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 7; reason: | |
llm |
LLMInferenceServiceController |
echo-simulator |
LLMInferenceServiceReady |
LLMInferenceService [echo-simulator] is Ready | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
AddedInterface |
Add eth0 [10.132.0.54/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
Updated |
Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
Created |
Container created | |
llm |
LLMInferenceServiceController |
facebook-opt-125m-simulated |
LLMInferenceServiceReady |
LLMInferenceService [facebook-opt-125m-simulated] is Ready | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
Updated |
Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
premium-simulated-simulated-premium |
LLMInferenceServiceReady |
LLMInferenceService [premium-simulated-simulated-premium] is Ready | |
kuadrant-system |
replicaset-controller |
authorino-fb96bcc76 |
SuccessfulCreate |
Created pod: authorino-fb96bcc76-d9wdp | |
kuadrant-system |
kubelet |
authorino-fb96bcc76-d9wdp |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" | |
kuadrant-system |
multus |
authorino-fb96bcc76-d9wdp |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
Unhealthy |
Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
ProbeError |
Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body: |
kuadrant-system |
kubelet |
authorino-fb96bcc76-d9wdp |
Created |
Container created | |
kuadrant-system |
kubelet |
authorino-fb96bcc76-d9wdp |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.755s (1.755s including waiting). Image size: 204096810 bytes. | |
kuadrant-system |
kubelet |
authorino-fb96bcc76-d9wdp |
Started |
Container started | |
| (x2) | kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
(combined from similar events): Scaled down replica set authorino-bc9d986f5 from 1 to 0 |
kuadrant-system |
kubelet |
authorino-bc9d986f5-bqcdf |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
authorino-bc9d986f5 |
SuccessfulDelete |
Deleted pod: authorino-bc9d986f5-bqcdf | |
openshift-ingress |
gateway_labeler_controller |
e2e-worker-w0-b1703c |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-b1703c | |
openshift-ingress |
gateway_labeler_controller |
e2e-worker-w3-4b9210 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-4b9210 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s | |
openshift-ingress |
gateway_labeler_controller |
e2e-praxis-a-b6f3d8 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b6f3d8 | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 0 to 1 | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
AddedInterface |
Add eth0 [10.133.0.41/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 0 to 1 | |
openshift-ingress |
multus |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
AddedInterface |
Add eth0 [10.133.0.42/23] from ovn-kubernetes | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
e2e-praxis-a-b6f3d8-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-praxis-a-b6f3d8-openshift-default-848f7897df from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df |
SuccessfulCreate |
Created pod: e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7 |
FailedCreate |
Error creating: pods "payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-b1703c: serviceaccount "payload-processing-e2e-worker-w0-b1703c" not found |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-b1703c: serviceaccount "payload-processing-e2e-worker-w0-b1703c" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7 |
SuccessfulCreate |
Created pod: payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-worker-w0-b1703c |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-worker-w0-b1703c |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-worker-w0-b1703c-5cb549d5b7 from 0 to 1 | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h |
Started |
Container started | |
openshift-ingress |
multus |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h |
AddedInterface |
Add eth0 [10.133.0.44/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l |
Created |
Container created | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4b9210: serviceaccount "payload-processing-e2e-worker-w3-4b9210" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-worker-w3-4b9210 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-worker-w3-4b9210 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-worker-w3-4b9210-bb856757c from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-w3-4b9210-bb856757c |
SuccessfulCreate |
Created pod: payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-w3-4b9210-bb856757c |
FailedCreate |
Error creating: pods "payload-processing-e2e-worker-w3-4b9210-bb856757c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4b9210: serviceaccount "payload-processing-e2e-worker-w3-4b9210" not found |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b6f3d8: serviceaccount "payload-processing-e2e-praxis-a-b6f3d8" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-praxis-a-b6f3d8 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-praxis-a-b6f3d8-674788f46f from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f |
FailedCreate |
Error creating: pods "payload-processing-e2e-praxis-a-b6f3d8-674788f46f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b6f3d8: serviceaccount "payload-processing-e2e-praxis-a-b6f3d8" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-praxis-a-b6f3d8 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5 from 0 to 1 | |
openshift-ingress |
multus |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f |
SuccessfulCreate |
Created pod: payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn | |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.329s (3.329s including waiting). Image size: 125353963 bytes. | |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
Started |
Container started | |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Started |
Container started |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
ProbeError |
Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x5) | openshift-ingress |
kubelet |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
ProbeError |
Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
ProbeError |
Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
Unhealthy |
Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused |
openshift-ingress |
gateway_labeler_controller |
e2e-praxis-b-966817 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-966817 | |
openshift-ingress |
replicaset-controller |
e2e-praxis-b-966817-openshift-default-5b7cfc678f |
SuccessfulCreate |
Created pod: e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 | |
openshift-ingress |
deployment-controller |
e2e-praxis-b-966817-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-praxis-b-966817-openshift-default-5b7cfc678f from 0 to 1 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-mpqgm | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-gpkx2 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
(combined from similar events): Created pod: maas-default-gateway-openshift-default-6dcf757899-jhwsm | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 7 to 10 | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
openshift-ingress |
multus |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
AddedInterface |
Add eth0 [10.132.0.60/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulCreate |
Created pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-a-w4-dd087a |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-dd087a | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
Created |
Container created | |
openshift-ingress |
deployment-controller |
e2e-shared-a-w4-dd087a-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c from 0 to 1 | |
openshift-ingress |
multus |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
AddedInterface |
Add eth0 [10.132.0.61/23] from ovn-kubernetes | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-praxis-b-966817-55764c99b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-966817: serviceaccount "payload-processing-e2e-praxis-b-966817" not found |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-praxis-b-966817-84c64b8595 |
FailedCreate |
Error creating: pods "payload-processing-e2e-praxis-b-966817-84c64b8595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-966817: serviceaccount "payload-processing-e2e-praxis-b-966817" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-praxis-b-966817 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-praxis-b-966817-84c64b8595 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-praxis-b-966817 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-praxis-b-966817-55764c99b7 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
Unhealthy |
Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
ProbeError |
Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h |
AddedInterface |
Add eth0 [10.133.0.51/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-praxis-b-966817-84c64b8595 |
SuccessfulCreate |
Created pod: payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h |
Created |
Container created | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
ProbeError |
Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
Unhealthy |
Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx |
Started |
Container started | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx |
Created |
Container created | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
ProbeError |
Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body: |
openshift-ingress |
multus |
payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-a-w4-dd087a |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-dd087a: serviceaccount "payload-processing-e2e-shared-a-w4-dd087a" not found |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-w4-dd087a-769f959885 |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-a-w4-dd087a-769f959885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-dd087a: serviceaccount "payload-processing-e2e-shared-a-w4-dd087a" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-a-w4-dd087a |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-a-w4-dd087a-769f959885 from 0 to 1 | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-w4-dd087a-769f959885 |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-praxis-a-b6f3d8-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-praxis-a-b6f3d8-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h |
Started |
Container started | |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r |
AddedInterface |
Add eth0 [10.133.0.53/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
kubelet |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
Started |
Container started |
| (x5) | openshift-ingress |
kubelet |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
ProbeError |
Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
Started |
Container started |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 1 to 2 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-praxis-b-966817-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-praxis-b-966817-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
Unhealthy |
Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
ProbeError |
Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
Unhealthy |
Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
ProbeError |
Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body: |
openshift-ingress |
replicaset-controller |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 |
SuccessfulCreate |
Created pod: e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-b-w4-03c4e8 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-03c4e8 | |
openshift-ingress |
deployment-controller |
e2e-shared-b-w4-03c4e8-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 from 0 to 1 | |
openshift-ingress |
multus |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
AddedInterface |
Add eth0 [10.133.0.55/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-praxis-b-966817-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-praxis-b-966817-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-b-w4-03c4e8 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-b-w4-03c4e8 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79 from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-03c4e8: serviceaccount "payload-processing-e2e-shared-b-w4-03c4e8" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png | |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png |
AddedInterface |
Add eth0 [10.132.0.65/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-03c4e8: serviceaccount "payload-processing-e2e-shared-b-w4-03c4e8" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png |
Started |
Container started | |
openshift-ingress |
multus |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq |
AddedInterface |
Add eth0 [10.133.0.56/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
opendatahub |
multus |
test-curl-7221-dcee02 |
AddedInterface |
Add eth0 [10.132.0.66/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7221-dcee02 |
Pulling |
Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
opendatahub |
kubelet |
test-curl-7221-dcee02 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7221-dcee02 |
Created |
Container created | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
opendatahub |
kubelet |
test-curl-7221-dcee02 |
Pulled |
Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.308s (2.308s including waiting). Image size: 106100986 bytes. | |
opendatahub |
kubelet |
test-curl-7221-219746 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-7221-219746 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7221-219746 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7221-dcee02 |
Killing |
Stopping container test-curl-7221-dcee02 | |
opendatahub |
multus |
test-curl-7221-219746 |
AddedInterface |
Add eth0 [10.132.0.67/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7221-219746 |
Killing |
Stopping container test-curl-7221-219746 | |
openshift-ingress |
replicaset-controller |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f |
SuccessfulCreate |
Created pod: e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd | |
openshift-ingress |
gateway_labeler_controller |
e2e-inf-a-7bd72e |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7bd72e | |
openshift-ingress |
deployment-controller |
e2e-inf-a-7bd72e-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f from 0 to 1 | |
openshift-ingress |
multus |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
AddedInterface |
Add eth0 [10.133.0.57/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-inf-a-7bd72e |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-inf-a-7bd72e-698968c8bc from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-inf-a-7bd72e |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-inf-a-7bd72e-65db86f979 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-a-7bd72e-698968c8bc |
SuccessfulCreate |
Created pod: payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7bd72e: serviceaccount "payload-processing-e2e-inf-a-7bd72e" not found |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-a-7bd72e-698968c8bc |
FailedCreate |
Error creating: pods "payload-processing-e2e-inf-a-7bd72e-698968c8bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7bd72e: serviceaccount "payload-processing-e2e-inf-a-7bd72e" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k |
Created |
Container created | |
openshift-ingress |
multus |
payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k |
AddedInterface |
Add eth0 [10.132.0.69/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 |
AddedInterface |
Add eth0 [10.132.0.68/23] from ovn-kubernetes | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 1 to 2 | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
AddedInterface |
Add eth0 [10.133.0.58/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
Created |
Container created | |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
Unhealthy |
Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
ProbeError |
Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
AddedInterface |
Add eth0 [10.132.0.71/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
Started |
Container started | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
Unhealthy |
Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
Created |
Container created | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
ProbeError |
Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
Created |
Container created | |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
Unhealthy |
Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
ProbeError |
Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
Unhealthy |
Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
ProbeError |
Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body: |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 4 to 5 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
Started |
Container started | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
AddedInterface |
Add eth0 [10.133.0.60/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
Created |
Container created | |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
ProbeError |
Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused | |
openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
ProbeError |
Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
SuccessfulRescale |
New size: 4; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
AddedInterface |
Add eth0 [10.133.0.62/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 2 to 4 | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x5) | openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
Unhealthy |
Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
ProbeError |
Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
ProbeError |
Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
ProbeError |
Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-a-7bd72e-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-a-7bd72e-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 7; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 5 to 7 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
AddedInterface |
Add eth0 [10.133.0.64/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
Started |
Container started | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
AddedInterface |
Add eth0 [10.132.0.74/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
ProbeError |
Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
Unhealthy |
Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
ProbeError |
Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-a-7bd72e-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-a-7bd72e-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
gateway_labeler_controller |
e2e-inf-b-036f88 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-036f88 | |
openshift-ingress |
deployment-controller |
e2e-inf-b-036f88-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-inf-b-036f88-openshift-default-dbc8cc695 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-inf-b-036f88-openshift-default-dbc8cc695 |
SuccessfulCreate |
Created pod: e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw | |
openshift-ingress |
multus |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-inf-b-036f88 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-inf-b-036f88-6588f64457 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-036f88: serviceaccount "payload-processing-e2e-inf-b-036f88" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-b-036f88-6588f64457 |
SuccessfulCreate |
Created pod: payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-inf-b-036f88 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-inf-b-036f88-5b44fdb67 from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-b-036f88-6588f64457 |
FailedCreate |
Error creating: pods "payload-processing-e2e-inf-b-036f88-6588f64457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-036f88: serviceaccount "payload-processing-e2e-inf-b-036f88" not found |
openshift-ingress |
multus |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v |
AddedInterface |
Add eth0 [10.133.0.65/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 |
Created |
Container created | |
openshift-ingress |
multus |
payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 |
AddedInterface |
Add eth0 [10.133.0.66/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-b-036f88-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-b-036f88-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
AddedInterface |
Add eth0 [10.132.0.75/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
(combined from similar events): Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 10; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 7 to 10 | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
ProbeError |
Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
ProbeError |
Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
ProbeError |
Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
Unhealthy |
Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-praxis-a-b6f3d8-674788f46f-bvqgn |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-a-b6f3d8-578458c5f5-wrqgn |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.47:50052" within 1s: context deadline exceeded | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 4 to 6 | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
ProbeError |
Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
Started |
Container started | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
SuccessfulRescale |
New size: 6; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
AddedInterface |
Add eth0 [10.132.0.77/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
Started |
Container started |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
Unhealthy |
Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
Unhealthy |
Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
ProbeError |
Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
ProbeError |
Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
ProbeError |
Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
Unhealthy |
Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused |
openshift-ingress |
kubelet |
e2e-praxis-a-b6f3d8-openshift-default-848f7897df-zjxx9 |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-b-036f88-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-b-036f88-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
payload-processing-e2e-praxis-b-966817-84c64b8595-7lkkx |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-praxis-b-966817-55764c99b7-dgp6h |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
SuccessfulRescale |
New size: 8; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 | |
openshift-ingress |
kubelet |
e2e-praxis-b-966817-openshift-default-5b7cfc678f-lf9f5 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 6 to 8 | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
AddedInterface |
Add eth0 [10.132.0.78/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
Started |
Container started | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
AddedInterface |
Add eth0 [10.133.0.81/23] from ovn-kubernetes | |
openshift-ingress |
gateway_labeler_controller |
e2e-extmod-a-6ac03f |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6ac03f | |
openshift-ingress |
replicaset-controller |
e2e-extmod-a-6ac03f-openshift-default-568485c58f |
SuccessfulCreate |
Created pod: e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ddhbn |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gpkx2 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-extmod-a-6ac03f-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-extmod-a-6ac03f-openshift-default-568485c58f from 0 to 1 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jhwsm |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-gpkx2 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mg624 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-jhwsm | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zkvl6 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 10 to 4 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-zkvl6 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-sn8dd |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-ddhbn | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-mg624 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-sn8dd | |
openshift-ingress |
multus |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
AddedInterface |
Add eth0 [10.133.0.82/23] from ovn-kubernetes | |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
ProbeError |
Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
ProbeError |
Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
Unhealthy |
Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-extmod-a-6ac03f |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-extmod-a-6ac03f |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-extmod-a-6ac03f-75c4d699fc from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6ac03f: serviceaccount "payload-processing-e2e-extmod-a-6ac03f" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc |
FailedCreate |
Error creating: pods "payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6ac03f: serviceaccount "payload-processing-e2e-extmod-a-6ac03f" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc |
SuccessfulCreate |
Created pod: payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 |
Started |
Container started | |
openshift-ingress |
multus |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm |
AddedInterface |
Add eth0 [10.132.0.79/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 |
AddedInterface |
Add eth0 [10.132.0.80/23] from ovn-kubernetes | |
openshift-ingress |
multus |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
AddedInterface |
Add eth0 [10.133.0.90/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulCreate |
Created pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
e2e-shared-a-w4-dd087a-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c from 1 to 2 | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
Started |
Container started | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
ProbeError |
Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
Unhealthy |
Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-b-036f88-openshift-default |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-inf-b-036f88-openshift-default-dbc8cc695 |
SuccessfulCreate |
Created pod: e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 | |
openshift-ingress |
deployment-controller |
e2e-inf-b-036f88-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-inf-b-036f88-openshift-default-dbc8cc695 from 1 to 2 | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
AddedInterface |
Add eth0 [10.132.0.83/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 8 to 10 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
SuccessfulRescale |
New size: 10; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulCreate |
(combined from similar events): Created pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
AddedInterface |
Add eth0 [10.132.0.84/23] from ovn-kubernetes | |
openshift-ingress |
multus |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
AddedInterface |
Add eth0 [10.134.0.55/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-cjqgb | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cjqgb |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
Created |
Container created | |
| (x8) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
ProbeError |
Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
Unhealthy |
Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
ProbeError |
Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
Unhealthy |
Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
ProbeError |
Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body: |
opendatahub |
multus |
test-curl-7227-2f49b6 |
AddedInterface |
Add eth0 [10.134.0.56/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7227-2f49b6 |
Pulling |
Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" | |
opendatahub |
kubelet |
test-curl-7227-2f49b6 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7227-2f49b6 |
Pulled |
Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.362s (2.362s including waiting). Image size: 106100986 bytes. | |
opendatahub |
kubelet |
test-curl-7227-2f49b6 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7227-2f49b6 |
Killing |
Stopping container test-curl-7227-2f49b6 | |
openshift-ingress |
deployment-controller |
e2e-shared-b-w4-03c4e8-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 from 1 to 2 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 |
SuccessfulCreate |
Created pod: e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj | |
openshift-ingress |
multus |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
AddedInterface |
Add eth0 [10.132.0.86/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
Started |
Container started | |
| (x6) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
ProbeError |
Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
Unhealthy |
Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused |
| (x2) | openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
ProbeError |
Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-a-6ac03f-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-a-6ac03f-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
gateway_labeler_controller |
e2e-extmod-b-3a78b4 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-3a78b4 | |
openshift-ingress |
deployment-controller |
e2e-extmod-b-3a78b4-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-extmod-b-3a78b4-openshift-default-77b8648d45 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45 |
SuccessfulCreate |
Created pod: e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m | |
openshift-ingress |
multus |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
AddedInterface |
Add eth0 [10.133.0.101/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795 |
FailedCreate |
Error creating: pods "payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3a78b4: serviceaccount "payload-processing-e2e-extmod-b-3a78b4" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-extmod-b-3a78b4 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-extmod-b-3a78b4-54f9b5d795 from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3a78b4: serviceaccount "payload-processing-e2e-extmod-b-3a78b4" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-extmod-b-3a78b4 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795 |
SuccessfulCreate |
Created pod: payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 | |
openshift-ingress |
multus |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 |
AddedInterface |
Add eth0 [10.133.0.103/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk |
AddedInterface |
Add eth0 [10.133.0.104/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7227-34e6b1 |
Started |
Container started | |
opendatahub |
multus |
test-curl-7227-34e6b1 |
AddedInterface |
Add eth0 [10.134.0.57/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7227-34e6b1 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-7227-34e6b1 |
Created |
Container created | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-a-6ac03f-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-a-6ac03f-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
opendatahub |
kubelet |
test-curl-7227-34e6b1 |
Killing |
Stopping container test-curl-7227-34e6b1 | |
opendatahub |
kubelet |
test-curl-7227-97f775 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
multus |
test-curl-7227-97f775 |
AddedInterface |
Add eth0 [10.134.0.58/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7227-97f775 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7227-97f775 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7227-97f775 |
Killing |
Stopping container test-curl-7227-97f775 | |
opendatahub |
multus |
test-curl-7227-634ce0 |
AddedInterface |
Add eth0 [10.134.0.59/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7227-634ce0 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-7227-634ce0 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7227-634ce0 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7227-6891a7 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-7227-634ce0 |
Killing |
Stopping container test-curl-7227-634ce0 | |
opendatahub |
multus |
test-curl-7227-6891a7 |
AddedInterface |
Add eth0 [10.134.0.60/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7227-6891a7 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7227-6891a7 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7227-6891a7 |
Killing |
Stopping container test-curl-7227-6891a7 | |
openshift-ingress |
deployment-controller |
e2e-inf-b-036f88-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-inf-b-036f88-openshift-default-dbc8cc695 from 2 to 3 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-inf-b-036f88-openshift-default |
SuccessfulRescale |
New size: 3; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-inf-b-036f88-openshift-default-dbc8cc695 |
SuccessfulCreate |
Created pod: e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd | |
openshift-ingress |
multus |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
AddedInterface |
Add eth0 [10.133.0.108/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
Created |
Container created | |
| (x6) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
Unhealthy |
Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
ProbeError |
Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body: |
| (x2) | llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.52:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
Created |
Container created |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
ProbeError |
Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
Unhealthy |
Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
Unhealthy |
Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
ProbeError |
Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 |
Killing |
Stopping container payload-pre-processing | |
| (x2) | llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.52:8000/ready": context deadline exceeded |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-7bd72e-698968c8bc-dps8k |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-7bd72e-65db86f979-chl84 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
e2e-inf-a-7bd72e-openshift-default-6fd8c7d56f-ld8bd |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
gateway_labeler_controller |
e2e-mt-6a432197 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6a432197 | |
openshift-ingress |
replicaset-controller |
e2e-mt-6a432197-openshift-default-6c5bc96b97 |
SuccessfulCreate |
Created pod: e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd | |
openshift-ingress |
deployment-controller |
e2e-mt-6a432197-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-mt-6a432197-openshift-default-6c5bc96b97 from 0 to 1 | |
openshift-ingress |
multus |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
AddedInterface |
Add eth0 [10.132.0.91/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-036f88-6588f64457-jfg29 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-036f88-5b44fdb67-hhq4v |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-mxp92 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-mt-6a432197 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-mt-6a432197-6d85858967 from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-6a432197-6d85858967 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-mt-6a432197-6d85858967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6a432197: serviceaccount "payload-processing-e2e-mt-6a432197" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-mt-6a432197 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-mt-6a432197-749f9ff54f from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-6a432197-749f9ff54f |
FailedCreate |
Error creating: pods "payload-processing-e2e-mt-6a432197-749f9ff54f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6a432197: serviceaccount "payload-processing-e2e-mt-6a432197" not found |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxp92 |
ProbeError |
Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-6a432197-749f9ff54f |
SuccessfulCreate |
Created pod: payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g |
Started |
Container started | |
openshift-ingress |
multus |
payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 |
AddedInterface |
Add eth0 [10.133.0.126/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g |
AddedInterface |
Add eth0 [10.133.0.125/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-6a432197-6d85858967 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 |
Created |
Container created | |
| (x3) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
ProbeError |
Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x6) | llm |
kubelet |
premium-simulated-simulated-premium-kserve-5f5c4b459f-d54rw |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.52:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-vm5lw |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-prtjd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-inf-b-036f88-openshift-default-dbc8cc695-knp62 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
replicaset-controller |
e2e-ait-fbf1444a-openshift-default-78d99bcf77 |
SuccessfulCreate |
Created pod: e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt | |
openshift-ingress |
deployment-controller |
e2e-ait-fbf1444a-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ait-fbf1444a-openshift-default-78d99bcf77 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-ait-fbf1444a |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ait-fbf1444a | |
openshift-ingress |
multus |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
AddedInterface |
Add eth0 [10.133.0.130/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ait-fbf1444a |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ait-fbf1444a-5b8dbb7699 from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699 |
FailedCreate |
Error creating: pods "payload-processing-e2e-ait-fbf1444a-5b8dbb7699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fbf1444a: serviceaccount "payload-processing-e2e-ait-fbf1444a" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ait-fbf1444a |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ait-fbf1444a-56db895c4c from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fbf1444a: serviceaccount "payload-processing-e2e-ait-fbf1444a" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699 |
SuccessfulCreate |
Created pod: payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt |
AddedInterface |
Add eth0 [10.133.0.134/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt |
Started |
Container started | |
openshift-ingress |
multus |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 |
AddedInterface |
Add eth0 [10.133.0.133/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
Started |
Container started |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-6a432197-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-6a432197-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
ProbeError |
Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
Unhealthy |
Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-6a432197-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-6a432197-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
Unhealthy |
Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
ProbeError |
Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body: |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-fbf1444a-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-fbf1444a-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
ProbeError |
Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-fbf1444a-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-fbf1444a-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
ProbeError |
Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-fbf1444a-5b8dbb7699-rtgv2 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-fbf1444a-56db895c4c-5vjxt |
Killing |
Stopping container payload-pre-processing | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-866d944846 from 0 to 1 | |
| (x8) | models-as-a-service |
replicaset-controller |
payload-processing-external-model-866d944846 |
FailedCreate |
Error creating: pods "payload-processing-external-model-866d944846-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-866d944846 |
SuccessfulCreate |
Created pod: payload-processing-external-model-866d944846-nnbj2 | |
openshift-ingress |
kubelet |
e2e-ait-fbf1444a-openshift-default-78d99bcf77-x2vzt |
Killing |
Stopping container istio-proxy | |
models-as-a-service |
multus |
payload-processing-external-model-866d944846-nnbj2 |
AddedInterface |
Add eth0 [10.133.0.145/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-866d944846-nnbj2 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7224-62bbdb |
Pulling |
Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" | |
opendatahub |
multus |
test-curl-7224-62bbdb |
AddedInterface |
Add eth0 [10.133.0.146/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-866d944846-nnbj2 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
kubelet |
payload-processing-external-model-866d944846-nnbj2 |
Created |
Container created | |
openshift-ingress |
deployment-controller |
e2e-migrate-1cc3a7b3-gw-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5 from 0 to 1 | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7224-62bbdb |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5 |
SuccessfulCreate |
Created pod: e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
Created |
Container created | |
openshift-ingress |
gateway_labeler_controller |
e2e-migrate-1cc3a7b3-gw |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-1cc3a7b3-gw | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulCreate |
Created pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z | |
openshift-ingress |
multus |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
AddedInterface |
Add eth0 [10.134.0.65/23] from ovn-kubernetes | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
SuccessfulRescale |
New size: 3; reason: cpu resource utilization (percentage of request) above target | |
opendatahub |
kubelet |
test-curl-7224-62bbdb |
Created |
Container created | |
openshift-ingress |
deployment-controller |
e2e-shared-a-w4-dd087a-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c from 2 to 3 | |
opendatahub |
kubelet |
test-curl-7224-62bbdb |
Pulled |
Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.076s (1.076s including waiting). Image size: 106100986 bytes. | |
openshift-ingress |
multus |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
AddedInterface |
Add eth0 [10.132.0.95/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7224-62bbdb |
Killing |
Stopping container test-curl-7224-62bbdb | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq | |
| (x7) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
ProbeError |
Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1cc3a7b3: serviceaccount "payload-processing-e2e-migrate-1cc3a7b3" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-migrate-1cc3a7b3 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-migrate-1cc3a7b3 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-migrate-1cc3a7b3-6f865874bc from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc |
FailedCreate |
Error creating: pods "payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1cc3a7b3: serviceaccount "payload-processing-e2e-migrate-1cc3a7b3" not found |
| (x7) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
Unhealthy |
Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g |
Started |
Container started | |
openshift-ingress |
multus |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq |
AddedInterface |
Add eth0 [10.133.0.148/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq |
Created |
Container created | |
openshift-ingress |
multus |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g |
AddedInterface |
Add eth0 [10.133.0.149/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc |
SuccessfulCreate |
Created pod: payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Created |
Container created | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 3; reason: cpu resource utilization (percentage of request) above target |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-62r9f | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 2 to 3 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
AddedInterface |
Add eth0 [10.132.0.96/23] from ovn-kubernetes | |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Unhealthy |
Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
ProbeError |
Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Unhealthy |
Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
ProbeError |
Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-749cdcd88d |
SuccessfulCreate |
Created pod: payload-processing-external-model-749cdcd88d-dm2dx | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-749cdcd88d from 0 to 1 | |
models-as-a-service |
multus |
payload-processing-external-model-749cdcd88d-dm2dx |
AddedInterface |
Add eth0 [10.133.0.151/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-749cdcd88d-dm2dx |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-lwhz4 | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
AddedInterface |
Add eth0 [10.132.0.97/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
AddedInterface |
Add eth0 [10.134.0.66/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 3 to 6 |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-lvhwz | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 6; reason: cpu resource utilization (percentage of request) above target |
models-as-a-service |
kubelet |
payload-processing-external-model-749cdcd88d-dm2dx |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-jmqgd | |
models-as-a-service |
kubelet |
payload-processing-external-model-749cdcd88d-dm2dx |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
AddedInterface |
Add eth0 [10.133.0.152/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Started |
Container started | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-qchj4 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-h6n4g |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
ProbeError |
Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
ProbeError |
Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
ProbeError |
Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Unhealthy |
Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Unhealthy |
Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Unhealthy |
Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
ProbeError |
Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Unhealthy |
Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
ProbeError |
Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
ProbeError |
Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-62g8c | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-mxd45 | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 6 to 10 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-7hsh2 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-jthbv | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
AddedInterface |
Add eth0 [10.133.0.153/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
AddedInterface |
Add eth0 [10.133.0.154/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
AddedInterface |
Add eth0 [10.132.0.98/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
AddedInterface |
Add eth0 [10.134.0.68/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Unhealthy |
Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
ProbeError |
Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
ProbeError |
Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
ProbeError |
Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
ProbeError |
Startup probe error: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
Unhealthy |
Startup probe failed: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Unhealthy |
Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
ProbeError |
Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
ProbeError |
Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
| (x2) | openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
ProbeError |
Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x5) | openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Unhealthy |
Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
ProbeError |
Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
AddedInterface |
Add eth0 [10.133.0.157/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-mt-6a432197-openshift-default-6c5bc96b97 |
SuccessfulCreate |
Created pod: e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-6a432197-openshift-default |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
e2e-mt-6a432197-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-mt-6a432197-openshift-default-6c5bc96b97 from 1 to 2 | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
Started |
Container started | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-migrate-1cc3a7b3-gw-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-migrate-1cc3a7b3-gw-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
Unhealthy |
Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
ProbeError |
Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body: |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled down replica set payload-processing-external-model-749cdcd88d from 1 to 0 | |
| (x6) | models-as-a-service |
kubelet |
payload-processing-external-model-749cdcd88d-dm2dx |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
models-as-a-service |
kubelet |
payload-processing-external-model-749cdcd88d-dm2dx |
Killing |
Stopping container payload-processing | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-749cdcd88d |
SuccessfulDelete |
Deleted pod: payload-processing-external-model-749cdcd88d-dm2dx | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-7bc9c479f4 |
SuccessfulCreate |
Created pod: payload-processing-external-model-7bc9c479f4-zpmgw | |
models-as-a-service |
multus |
payload-processing-external-model-7bc9c479f4-zpmgw |
AddedInterface |
Add eth0 [10.132.0.100/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-zpmgw |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-zpmgw |
Started |
Container started | |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-zpmgw |
Created |
Container created | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-mt-6a432197 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-mt-6a432197-749f9ff54f from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-mt-6a432197 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-mt-6a432197-6d85858967 from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-6a432197-6d85858967 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-mt-6a432197-6d85858967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6a432197: serviceaccount "payload-processing-e2e-mt-6a432197" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-6a432197-749f9ff54f |
SuccessfulCreate |
Created pod: payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-6a432197-749f9ff54f |
FailedCreate |
Error creating: pods "payload-processing-e2e-mt-6a432197-749f9ff54f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6a432197: serviceaccount "payload-processing-e2e-mt-6a432197" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-6a432197-6d85858967 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt |
Created |
Container created | |
openshift-ingress |
multus |
payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k |
AddedInterface |
Add eth0 [10.133.0.160/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt |
AddedInterface |
Add eth0 [10.133.0.158/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-zpmgw |
Killing |
Stopping container payload-processing | |
models-as-a-service |
multus |
payload-processing-external-model-5cc9844f6-pv7vm |
AddedInterface |
Add eth0 [10.133.0.161/23] from ovn-kubernetes | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-5cc9844f6 from 0 to 1 | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled down replica set payload-processing-external-model-7bc9c479f4 from 1 to 0 | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-7bc9c479f4 |
SuccessfulDelete |
Deleted pod: payload-processing-external-model-7bc9c479f4-zpmgw | |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-zpmgw |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-5cc9844f6 |
SuccessfulCreate |
Created pod: payload-processing-external-model-5cc9844f6-pv7vm | |
models-as-a-service |
kubelet |
payload-processing-external-model-5cc9844f6-pv7vm |
Created |
Container created | |
models-as-a-service |
kubelet |
payload-processing-external-model-5cc9844f6-pv7vm |
Started |
Container started | |
models-as-a-service |
kubelet |
payload-processing-external-model-5cc9844f6-pv7vm |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7ddd9cfdc8 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7ddd9cfdc8-r577d | |
openshift-ingress |
multus |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
AddedInterface |
Add eth0 [10.132.0.102/23] from ovn-kubernetes | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" | |
openshift-ingress |
multus |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
AddedInterface |
Add eth0 [10.134.0.69/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45 |
SuccessfulCreate |
Created pod: e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 | |
openshift-ingress |
deployment-controller |
e2e-shared-a-w4-dd087a-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c from 3 to 4 | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulCreate |
Created pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
SuccessfulRescale |
New size: 4; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-1cc3a7b3-5699648675-dcrpq |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g |
Killing |
Stopping container payload-processing | |
| (x6) | models-as-a-service |
kubelet |
payload-processing-external-model-866d944846-nnbj2 |
FailedMount |
MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-15ea039108c9" not found |
openshift-ingress |
multus |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
AddedInterface |
Add eth0 [10.133.0.162/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
Created |
Container created | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-migrate-1cc3a7b3-gw-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
Started |
Container started | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 6.365s (6.365s including waiting). Image size: 185476477 bytes. | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-migrate-1cc3a7b3-gw-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
Started |
Container started | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-866d944846 |
SuccessfulDelete |
Deleted pod: payload-processing-external-model-866d944846-nnbj2 | |
models-as-a-service |
kubelet |
payload-processing-external-model-866d944846-nnbj2 |
Killing |
Stopping container payload-processing | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled down replica set payload-processing-external-model-866d944846 from 1 to 0 | |
| (x2) | openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
ProbeError |
Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-1cc3a7b3-6f865874bc-t6n8g |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.149:50052" within 1s: context deadline exceeded | |
| (x6) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
ProbeError |
Startup probe error: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
Unhealthy |
Startup probe failed: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused |
openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
gateway_labeler_controller |
e2e-ait-9cbdfaf1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9cbdfaf1 | |
openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
deployment-controller |
e2e-ait-9cbdfaf1-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ait-9cbdfaf1-openshift-default-7dbbc655c from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c |
SuccessfulCreate |
Created pod: e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl | |
openshift-ingress |
kubelet |
e2e-migrate-1cc3a7b3-gw-openshift-default-b9f9fc5d5-wn6fm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
multus |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
AddedInterface |
Add eth0 [10.133.0.164/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c |
SuccessfulCreate |
Created pod: payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ait-9cbdfaf1 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ait-9cbdfaf1-58867fd66c from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9cbdfaf1: serviceaccount "payload-processing-e2e-ait-9cbdfaf1" not found |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c |
FailedCreate |
Error creating: pods "payload-processing-e2e-ait-9cbdfaf1-58867fd66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9cbdfaf1: serviceaccount "payload-processing-e2e-ait-9cbdfaf1" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ait-9cbdfaf1 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 |
AddedInterface |
Add eth0 [10.133.0.166/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq |
AddedInterface |
Add eth0 [10.133.0.165/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 |
Started |
Container started | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-9cbdfaf1-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-9cbdfaf1-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 10 to 6 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 6; reason: All metrics below target | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qz97d |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mvrj9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-crsbf |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-bz2vd |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
opendatahub |
multus |
test-curl-7224-6922d4 |
AddedInterface |
Add eth0 [10.134.0.71/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7224-6922d4 |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-7224-6922d4 |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7224-6922d4 |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7224-6922d4 |
Killing |
Stopping container test-curl-7224-6922d4 | |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
Started |
Container started |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
ProbeError |
Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
Unhealthy |
Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-6a432197-749f9ff54f-txt7k |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-6a432197-6d85858967-wmttt |
Killing |
Stopping container payload-pre-processing | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-9cbdfaf1-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-9cbdfaf1-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-9cbdfaf1-58867fd66c-l6spq |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-9cbdfaf1-97865bdbc-gkn29 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-f62hd |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-mt-6a432197-openshift-default-6c5bc96b97-p6c8d |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-ait-ccee868d-openshift-default-5c76b6887c |
SuccessfulCreate |
Created pod: e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp | |
openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-ait-9cbdfaf1-openshift-default-7dbbc655c-fw8dl |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
gateway_labeler_controller |
e2e-ait-ccee868d |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ccee868d | |
openshift-ingress |
deployment-controller |
e2e-ait-ccee868d-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ait-ccee868d-openshift-default-5c76b6887c from 0 to 1 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
ProbeError |
Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
ProbeError |
Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
ProbeError |
Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
ProbeError |
Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
multus |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
AddedInterface |
Add eth0 [10.134.0.73/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
ProbeError |
Readiness probe error: Get "http://10.133.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
SuccessfulRescale |
New size: 5; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
AddedInterface |
Add eth0 [10.134.0.74/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulCreate |
Created pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj | |
openshift-ingress |
deployment-controller |
e2e-shared-a-w4-dd087a-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c from 4 to 5 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ait-ccee868d |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ait-ccee868d-579cd68b9f from 0 to 1 | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-ccee868d-579cd68b9f |
SuccessfulCreate |
Created pod: payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-ccee868d-579cd68b9f |
FailedCreate |
Error creating: pods "payload-processing-e2e-ait-ccee868d-579cd68b9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ccee868d: serviceaccount "payload-processing-e2e-ait-ccee868d" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-ccee868d-566b985687 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ait-ccee868d |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ait-ccee868d-566b985687 from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-ccee868d-566b985687 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ait-ccee868d-566b985687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ccee868d: serviceaccount "payload-processing-e2e-ait-ccee868d" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g |
Pulling |
Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" | |
openshift-ingress |
multus |
payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g |
AddedInterface |
Add eth0 [10.134.0.75/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 |
Started |
Container started | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 |
AddedInterface |
Add eth0 [10.133.0.170/23] from ovn-kubernetes | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
ProbeError |
Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.122s (3.122s including waiting). Image size: 125353963 bytes. | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g |
Started |
Container started | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
Unhealthy |
Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulDelete |
Deleted pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-srf5s |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulDelete |
Deleted pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-t2gpk | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulDelete |
Deleted pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulDelete |
Deleted pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
SuccessfulRescale |
New size: 6; reason: All metrics below target | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-bf58s |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-4952w |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 10 to 6 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
SuccessfulRescale |
New size: 3; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45 |
SuccessfulCreate |
Created pod: e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m | |
openshift-ingress |
deployment-controller |
e2e-extmod-b-3a78b4-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-extmod-b-3a78b4-openshift-default-77b8648d45 from 2 to 3 | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
Started |
Container started | |
openshift-ingress |
multus |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
AddedInterface |
Add eth0 [10.132.0.103/23] from ovn-kubernetes | |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
Unhealthy |
Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
ProbeError |
Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
ProbeError |
Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
Unhealthy |
Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-ccee868d-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-ccee868d-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-ccee868d-566b985687-vxcc7 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-ccee868d-579cd68b9f-rt76g |
Killing |
Stopping container payload-processing | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulDelete |
Deleted pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 |
SuccessfulDelete |
Deleted pod: e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w0-b1703c-openshift-default |
SuccessfulRescale |
New size: 4; reason: All metrics below target | |
openshift-ingress |
deployment-controller |
e2e-worker-w0-b1703c-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-worker-w0-b1703c-openshift-default-6755bbfdc7 from 6 to 4 | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-gbqcg |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
gateway_labeler_controller |
e2e-derive-02304760 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-derive-02304760 | |
openshift-ingress |
kubelet |
e2e-ait-ccee868d-openshift-default-5c76b6887c-ttszp |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-ccee868d-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-ccee868d-openshift-default |
FailedUpdateStatus |
horizontalpodautoscalers.autoscaling "e2e-ait-ccee868d-openshift-default" not found | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-ccee868d-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
deployment-controller |
e2e-derive-02304760-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-derive-02304760-openshift-default-5f76687f89 from 0 to 1 | |
openshift-ingress |
multus |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
AddedInterface |
Add eth0 [10.134.0.78/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-derive-02304760-openshift-default-5f76687f89 |
SuccessfulCreate |
Created pod: e2e-derive-02304760-openshift-default-5f76687f89-s72l8 | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 6 to 5 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 5; reason: All metrics below target |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-lg4rm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:51614->10.133.0.62:15021: read: connection reset by peer | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-qx4f8 |
ProbeError |
Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:51614->10.133.0.62:15021: read: connection reset by peer body: | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-derive-02304760 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-derive-02304760-6f86dfbb8c from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-derive-02304760 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-derive-02304760-86c4f9d7f from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-derive-02304760-6f86dfbb8c |
FailedCreate |
Error creating: pods "payload-processing-e2e-derive-02304760-6f86dfbb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-02304760: serviceaccount "payload-processing-e2e-derive-02304760" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t | |
openshift-ingress |
multus |
payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r |
AddedInterface |
Add eth0 [10.133.0.177/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-derive-02304760-6f86dfbb8c |
SuccessfulCreate |
Created pod: payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-derive-02304760-86c4f9d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-02304760: serviceaccount "payload-processing-e2e-derive-02304760" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t |
AddedInterface |
Add eth0 [10.133.0.178/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t |
Started |
Container started | |
opendatahub |
multus |
test-curl-7227-18ebed |
AddedInterface |
Add eth0 [10.134.0.79/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7227-18ebed |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
kubelet |
test-curl-7227-18ebed |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7227-18ebed |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 3; reason: All metrics below target | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 5 to 3 | |
opendatahub |
kubelet |
test-curl-7227-77f79b |
Created |
Container created | |
opendatahub |
kubelet |
test-curl-7227-77f79b |
Started |
Container started | |
opendatahub |
kubelet |
test-curl-7227-77f79b |
Pulled |
Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod | |
opendatahub |
multus |
test-curl-7227-77f79b |
AddedInterface |
Add eth0 [10.134.0.80/23] from ovn-kubernetes | |
opendatahub |
kubelet |
test-curl-7227-18ebed |
Killing |
Stopping container test-curl-7227-18ebed | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-gc9v7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-h4xv7 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
opendatahub |
kubelet |
test-curl-7227-77f79b |
Killing |
Stopping container test-curl-7227-77f79b | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
SuccessfulRescale |
New size: 3; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 |
SuccessfulCreate |
Created pod: e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx | |
openshift-ingress |
deployment-controller |
e2e-shared-b-w4-03c4e8-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 from 2 to 3 | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
Created |
Container created | |
openshift-ingress |
multus |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
AddedInterface |
Add eth0 [10.134.0.81/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
Started |
Container started | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
Unhealthy |
Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
ProbeError |
Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body: |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-df544 |
Created |
Container created | |
models-as-a-service |
multus |
payload-processing-external-model-7bc9c479f4-df544 |
AddedInterface |
Add eth0 [10.133.0.188/23] from ovn-kubernetes | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-7bc9c479f4 |
SuccessfulCreate |
Created pod: payload-processing-external-model-7bc9c479f4-df544 | |
| (x2) | models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-7bc9c479f4 from 0 to 1 |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-df544 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-df544 |
Started |
Container started | |
models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-df544 |
Killing |
Stopping container payload-processing | |
| (x2) | models-as-a-service |
kubelet |
payload-processing-external-model-7bc9c479f4-df544 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
models-as-a-service |
kubelet |
payload-processing-external-model-5cc9844f6-pv7vm |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
ProbeError |
Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-derive-02304760-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-derive-02304760-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulDelete |
Deleted pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 2; reason: All metrics below target | |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 3 to 2 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-46r22 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
| (x5) | openshift-ingress |
kubelet |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
ProbeError |
Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h |
Killing |
Stopping container payload-processing | |
openshift-ingress |
deployment-controller |
e2e-autores-cf0095-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-autores-cf0095-openshift-default-66557c8649 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-autores-cf0095 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-autores-cf0095 | |
openshift-ingress |
replicaset-controller |
e2e-autores-cf0095-openshift-default-66557c8649 |
SuccessfulCreate |
Created pod: e2e-autores-cf0095-openshift-default-66557c8649-rjm2j | |
openshift-ingress |
multus |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
AddedInterface |
Add eth0 [10.133.0.191/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
e2e-shared-b-w4-03c4e8-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 from 3 to 4 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
SuccessfulRescale |
New size: 4; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 |
SuccessfulCreate |
Created pod: e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
AddedInterface |
Add eth0 [10.133.0.193/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-autores-cf0095-5dd5579d5f |
FailedCreate |
Error creating: pods "payload-processing-e2e-autores-cf0095-5dd5579d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-cf0095: serviceaccount "payload-processing-e2e-autores-cf0095" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-autores-cf0095 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-autores-cf0095-795f99687f from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-autores-cf0095-795f99687f |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-autores-cf0095-795f99687f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-cf0095: serviceaccount "payload-processing-e2e-autores-cf0095" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-autores-cf0095 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-autores-cf0095-5dd5579d5f from 0 to 1 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd |
AddedInterface |
Add eth0 [10.134.0.85/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd |
Created |
Container created | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
ProbeError |
Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body: |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-autores-cf0095-795f99687f |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd | |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
Unhealthy |
Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-autores-cf0095-5dd5579d5f |
SuccessfulCreate |
Created pod: payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv | |
openshift-ingress |
multus |
payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv |
AddedInterface |
Add eth0 [10.133.0.194/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-02304760-6f86dfbb8c-f554r |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-02304760-86c4f9d7f-v786t |
Killing |
Stopping container payload-pre-processing | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-derive-02304760-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-derive-02304760-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w0-b1703c-5d6cc6899f-99f2l |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-worker-w0-b1703c-5cb549d5b7-8f84h |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-9bd6p |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-lcmx9 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-zdvpp |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w0-b1703c-openshift-default-6755bbfdc7-x86b6 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-derive-02304760-openshift-default-5f76687f89-s72l8 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-api-a-2e101a-openshift-default-88548686f |
SuccessfulCreate |
Created pod: e2e-api-a-2e101a-openshift-default-88548686f-drm8q | |
openshift-ingress |
deployment-controller |
e2e-api-a-2e101a-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-api-a-2e101a-openshift-default-88548686f from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-api-a-2e101a |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2e101a | |
openshift-ingress |
multus |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
AddedInterface |
Add eth0 [10.133.0.195/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-api-a-2e101a |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9 from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2e101a: serviceaccount "payload-processing-e2e-api-a-2e101a" not found |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-a-2e101a-5457bf9f75 |
FailedCreate |
Error creating: pods "payload-processing-e2e-api-a-2e101a-5457bf9f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2e101a: serviceaccount "payload-processing-e2e-api-a-2e101a" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-api-a-2e101a |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-api-a-2e101a-5457bf9f75 from 0 to 1 | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-a-2e101a-5457bf9f75 |
SuccessfulCreate |
Created pod: payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx | |
openshift-ingress |
multus |
payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx |
AddedInterface |
Add eth0 [10.134.0.87/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v |
AddedInterface |
Add eth0 [10.133.0.196/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v |
Created |
Container created | |
| (x2) | openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x5) | openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
Unhealthy |
Startup probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
ProbeError |
Startup probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body: |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-autores-cf0095-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-autores-cf0095-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-autores-cf0095-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-autores-cf0095-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
Started |
Container started |
| (x6) | openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
ProbeError |
Startup probe error: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
Unhealthy |
Startup probe failed: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1 | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
SuccessfulRescale |
New size: 1; reason: All metrics below target | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7ddd9cfdc8 |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-r577d | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7ddd9cfdc8-r577d |
Killing |
Stopping container discovery | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-a-2e101a-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-a-2e101a-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
deployment-controller |
e2e-api-b-257e6d-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-api-b-257e6d-openshift-default-5dfc7946df from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-api-b-257e6d-openshift-default-5dfc7946df |
SuccessfulCreate |
Created pod: e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 | |
openshift-ingress |
gateway_labeler_controller |
e2e-api-b-257e6d |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-257e6d | |
openshift-ingress |
multus |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
AddedInterface |
Add eth0 [10.132.0.107/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-a-2e101a-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-a-2e101a-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
deployment-controller |
payload-processing-e2e-api-b-257e6d |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-api-b-257e6d-86977c947f from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-b-257e6d-86977c947f |
SuccessfulCreate |
Created pod: payload-processing-e2e-api-b-257e6d-86977c947f-t9chn | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-b-257e6d-86977c947f |
FailedCreate |
Error creating: pods "payload-processing-e2e-api-b-257e6d-86977c947f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-257e6d: serviceaccount "payload-processing-e2e-api-b-257e6d" not found |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-257e6d: serviceaccount "payload-processing-e2e-api-b-257e6d" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-api-b-257e6d |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-api-b-257e6d-5c49bdd555 from 0 to 1 | |
openshift-ingress |
multus |
payload-processing-e2e-api-b-257e6d-86977c947f-t9chn |
AddedInterface |
Add eth0 [10.133.0.197/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-257e6d-86977c947f-t9chn |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-257e6d-86977c947f-t9chn |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-257e6d-86977c947f-t9chn |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 |
AddedInterface |
Add eth0 [10.132.0.108/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
SuccessfulRescale |
New size: 2; reason: All metrics below target | |
openshift-ingress |
replicaset-controller |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45 |
SuccessfulDelete |
Deleted pod: e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 | |
openshift-ingress |
deployment-controller |
e2e-extmod-b-3a78b4-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-extmod-b-3a78b4-openshift-default-77b8648d45 from 3 to 2 | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-2d684 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-w3-4b9210-79ddd5fbc-k58k2 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-worker-w3-4b9210-bb856757c-b8bnr |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 4; reason: cpu resource utilization (percentage of request) above target |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl | |
| (x2) | openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 2 to 4 |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
AddedInterface |
Add eth0 [10.134.0.90/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
Created |
Container created | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
AddedInterface |
Add eth0 [10.132.0.110/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
e2e-extmod-b-3a78b4-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-extmod-b-3a78b4-openshift-default-77b8648d45 from 2 to 1 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
SuccessfulRescale |
New size: 1; reason: All metrics below target | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45 |
SuccessfulDelete |
Deleted pod: e2e-extmod-b-3a78b4-openshift-default-77b8648d45-9gj2m | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-autores-cf0095-795f99687f-f5gwd |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-autores-cf0095-5dd5579d5f-gg9mv |
Killing |
Stopping container payload-processing | |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
ProbeError |
Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
Unhealthy |
Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
Unhealthy |
Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
ProbeError |
Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
Started |
Container started |
openshift-ingress |
deployment-controller |
e2e-worker-w3-4b9210-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-w3-4b9210-openshift-default-dcf4c64c from 4 to 6 | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-w3-4b9210-openshift-default |
SuccessfulRescale |
New size: 6; reason: | |
openshift-ingress |
replicaset-controller |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c |
SuccessfulCreate |
Created pod: e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf | |
| (x5) | openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
ProbeError |
Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
Started |
Container started | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
AddedInterface |
Add eth0 [10.134.0.91/23] from ovn-kubernetes | |
| (x5) | openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
AddedInterface |
Add eth0 [10.133.0.200/23] from ovn-kubernetes | |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
ProbeError |
Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body: |
| (x6) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
Unhealthy |
Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
ProbeError |
Startup probe error: Get "http://10.133.0.200:15021/healthz/ready": dial tcp 10.133.0.200:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-m89q5 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-g469m |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
FailedToRetrieveImagePullSecret |
Unable to retrieve some image pull secrets (e2e-worker-w3-4b9210-openshift-default-dockercfg-fqcg6); attempting to pull the image may not succeed. |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-b-257e6d-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-b-257e6d-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-qd4kl |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-mwb4c |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-t2ltf |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-w3-4b9210-openshift-default-dcf4c64c-q9k87 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-explicit-6373b9-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-explicit-6373b9-openshift-default-6b89455cfc from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-explicit-6373b9 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-6373b9 | |
openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-autores-cf0095-openshift-default-66557c8649-rjm2j |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
replicaset-controller |
e2e-explicit-6373b9-openshift-default-6b89455cfc |
SuccessfulCreate |
Created pod: e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk | |
openshift-ingress |
multus |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
AddedInterface |
Add eth0 [10.132.0.111/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-b-257e6d-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-api-b-257e6d-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
deployment-controller |
payload-processing-e2e-explicit-6373b9 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-explicit-6373b9-85f9c445d5 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-explicit-6373b9 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-explicit-6373b9-5c9bfff747 from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-6373b9: serviceaccount "payload-processing-e2e-explicit-6373b9" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-explicit-6373b9-85f9c445d5 |
SuccessfulCreate |
Created pod: payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-explicit-6373b9-85f9c445d5 |
FailedCreate |
Error creating: pods "payload-processing-e2e-explicit-6373b9-85f9c445d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-6373b9: serviceaccount "payload-processing-e2e-explicit-6373b9" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd |
AddedInterface |
Add eth0 [10.133.0.202/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk |
AddedInterface |
Add eth0 [10.133.0.201/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-2e101a-5457bf9f75-9nhkx |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-2e101a-68f7d76dc9-cl42v |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-api-a-2e101a-openshift-default-88548686f-drm8q |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-257e6d-86977c947f-t9chn |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-257e6d-5c49bdd555-jgqm4 |
Killing |
Stopping container payload-pre-processing | |
| (x2) | openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
Started |
Container started |
| (x5) | openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
Unhealthy |
Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
ProbeError |
Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-api-b-257e6d-openshift-default-5dfc7946df-rdft4 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
| (x5) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-explicit-6373b9-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-explicit-6373b9-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
SuccessfulRescale |
New size: 3; reason: All metrics below target | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulDelete |
Deleted pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-shared-a-w4-dd087a-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c from 5 to 3 | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulDelete |
Deleted pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cr2cp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-cp4gj |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
SuccessfulRescale |
New size: 3; reason: All metrics below target | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 |
SuccessfulDelete |
Deleted pod: e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-shared-b-w4-03c4e8-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 from 4 to 3 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-lwhz4 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-62g8c | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mpqgm |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 10 to 5 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-mpqgm | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-a-w4-dd087a-openshift-default |
SuccessfulRescale |
New size: 2; reason: All metrics below target | |
openshift-ingress |
deployment-controller |
e2e-shared-a-w4-dd087a-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c from 3 to 2 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c |
SuccessfulDelete |
Deleted pod: e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-jthbv | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-mxd45 | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
ProbeError |
Readiness probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body: | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-77kfh |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-dqd9z |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mxd45 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lwhz4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62g8c |
ProbeError |
Readiness probe error: Get "http://10.133.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
ProbeError |
Readiness probe error: Get "http://10.133.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jthbv |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
openshift-ingress |
kubelet |
payload-processing-e2e-explicit-6373b9-85f9c445d5-x85bd |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-explicit-6373b9-5c9bfff747-cbblk |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 |
SuccessfulDelete |
Deleted pod: e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-shared-b-w4-03c4e8-openshift-default |
ScalingReplicaSet |
Scaled down replica set e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75 from 3 to 2 | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-shared-b-w4-03c4e8-openshift-default |
SuccessfulRescale |
New size: 2; reason: All metrics below target | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-bv5jx |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-noten-02c1d2-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-noten-02c1d2-openshift-default-84ff487789 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-noten-02c1d2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-noten-02c1d2 | |
openshift-ingress |
replicaset-controller |
e2e-noten-02c1d2-openshift-default-84ff487789 |
SuccessfulCreate |
Created pod: e2e-noten-02c1d2-openshift-default-84ff487789-gczvd | |
openshift-ingress |
multus |
e2e-noten-02c1d2-openshift-default-84ff487789-gczvd |
AddedInterface |
Add eth0 [10.133.0.203/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-noten-02c1d2-openshift-default-84ff487789-gczvd |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-noten-02c1d2-openshift-default-84ff487789-gczvd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
e2e-noten-02c1d2-openshift-default-84ff487789-gczvd |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-explicit-6373b9-openshift-default-6b89455cfc-wkqfk |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-noten-02c1d2-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-noten-02c1d2-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
kubelet |
e2e-noten-02c1d2-openshift-default-84ff487789-gczvd |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-4hjvz |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused | |
openshift-ingress |
kubelet |
e2e-shared-a-w4-dd087a-openshift-default-5b6fb74d8c-t6nlb |
ProbeError |
Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body: | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png |
Killing |
Stopping container payload-pre-processing | |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-w4-dd087a-5d8c4cc7b7-mhg4h |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-w4-dd087a-769f959885-x622r |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-tdk2d |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-shared-b-w4-03c4e8-openshift-default-6f858d7b75-4zsnj |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-w4-03c4e8-f89d5588f-5c4bq |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-w4-03c4e8-7df6c4df79-t5png |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-jmqgd | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 5 to 4 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-jmqgd |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
| (x2) | openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 4 to 3 |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-lvhwz |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-62r9f |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-th4ng | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-th4ng |
Killing |
Stopping container istio-proxy | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-978854467 from 0 to 1 | |
| (x8) | models-as-a-service |
replicaset-controller |
payload-processing-external-model-978854467 |
FailedCreate |
Error creating: pods "payload-processing-external-model-978854467-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found |
models-as-a-service |
multus |
payload-processing-external-model-978854467-vq6wf |
AddedInterface |
Add eth0 [10.133.0.231/23] from ovn-kubernetes | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-978854467 |
SuccessfulCreate |
Created pod: payload-processing-external-model-978854467-vq6wf | |
models-as-a-service |
kubelet |
payload-processing-external-model-978854467-vq6wf |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
kubelet |
payload-processing-external-model-978854467-vq6wf |
Created |
Container created | |
models-as-a-service |
kubelet |
payload-processing-external-model-978854467-vq6wf |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
AddedInterface |
Add eth0 [10.133.0.235/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-xhwwv | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-kj955 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
Started |
Container started | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-r6j5r | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
AddedInterface |
Add eth0 [10.134.0.97/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
AddedInterface |
Add eth0 [10.132.0.115/23] from ovn-kubernetes | |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
Unhealthy |
Startup probe failed: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
Unhealthy |
Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
ProbeError |
Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
ProbeError |
Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
ProbeError |
Startup probe error: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused body: |
models-as-a-service |
kubelet |
payload-processing-external-model-978854467-vq6wf |
Killing |
Stopping container payload-processing | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
AddedInterface |
Add eth0 [10.133.0.236/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 4 to 5 | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 5; reason: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
Created |
Container created | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-599b76764c from 0 to 1 | |
| (x8) | models-as-a-service |
replicaset-controller |
payload-processing-external-model-599b76764c |
FailedCreate |
Error creating: pods "payload-processing-external-model-599b76764c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-599b76764c |
SuccessfulCreate |
Created pod: payload-processing-external-model-599b76764c-tgzgs | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-tgzgs |
Started |
Container started | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-tgzgs |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-tgzgs |
Created |
Container created | |
models-as-a-service |
multus |
payload-processing-external-model-599b76764c-tgzgs |
AddedInterface |
Add eth0 [10.133.0.237/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-tgzgs |
Killing |
Stopping container payload-processing | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
ProbeError |
Startup probe error: Get "http://10.133.0.236:15021/healthz/ready": dial tcp 10.133.0.236:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
Unhealthy |
Startup probe failed: Get "http://10.133.0.236:15021/healthz/ready": dial tcp 10.133.0.236:15021: connect: connection refused |
| (x4) | models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-tgzgs |
FailedMount |
MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-13ffe4f19df1" not found |
| (x8) | models-as-a-service |
replicaset-controller |
payload-processing-external-model-599b76764c |
FailedCreate |
Error creating: pods "payload-processing-external-model-599b76764c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-599b76764c from 0 to 1 | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-599b76764c |
SuccessfulCreate |
Created pod: payload-processing-external-model-599b76764c-9xnbt | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-9xnbt |
Created |
Container created | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-9xnbt |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
multus |
payload-processing-external-model-599b76764c-9xnbt |
AddedInterface |
Add eth0 [10.133.0.238/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-9xnbt |
Started |
Container started | |
models-as-a-service |
kubelet |
payload-processing-external-model-599b76764c-9xnbt |
Killing |
Stopping container payload-processing | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-59f9b4bfb5 from 0 to 1 | |
| (x8) | models-as-a-service |
replicaset-controller |
payload-processing-external-model-59f9b4bfb5 |
FailedCreate |
Error creating: pods "payload-processing-external-model-59f9b4bfb5-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-59f9b4bfb5 |
SuccessfulCreate |
Created pod: payload-processing-external-model-59f9b4bfb5-ww55q | |
models-as-a-service |
kubelet |
payload-processing-external-model-59f9b4bfb5-ww55q |
Started |
Container started | |
models-as-a-service |
kubelet |
payload-processing-external-model-59f9b4bfb5-ww55q |
Created |
Container created | |
models-as-a-service |
kubelet |
payload-processing-external-model-59f9b4bfb5-ww55q |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
models-as-a-service |
multus |
payload-processing-external-model-59f9b4bfb5-ww55q |
AddedInterface |
Add eth0 [10.133.0.239/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-59f9b4bfb5-ww55q |
Killing |
Stopping container payload-processing | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 5 to 9 | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 9; reason: cpu resource utilization (percentage of request) above target | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
AddedInterface |
Add eth0 [10.134.0.98/23] from ovn-kubernetes | |
| (x4) | models-as-a-service |
kubelet |
payload-processing-external-model-59f9b4bfb5-ww55q |
FailedMount |
MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-897c4765e686" not found |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
AddedInterface |
Add eth0 [10.134.0.99/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
AddedInterface |
Add eth0 [10.133.0.240/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
AddedInterface |
Add eth0 [10.132.0.116/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
ProbeError |
Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
Unhealthy |
Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
ProbeError |
Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
Unhealthy |
Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
ProbeError |
Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
Unhealthy |
Startup probe failed: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
ProbeError |
Startup probe error: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xvknm |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 9 to 5 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-nchmc |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-ffnfw | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ffnfw |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r64l5 |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 5; reason: All metrics below target |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 3; reason: All metrics below target |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 5 to 3 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r6j5r |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wktxt |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-xhwwv | |
| (x3) | openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 3 to 2 |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-xhwwv |
Killing |
Stopping container istio-proxy | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 2; reason: All metrics below target |
| (x2) | openshift-ingress |
deployment-controller |
e2e-extmod-b-3a78b4-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-extmod-b-3a78b4-openshift-default-77b8648d45 from 1 to 2 |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-extmod-b-3a78b4-openshift-default |
SuccessfulRescale |
New size: 2; reason: cpu resource utilization (percentage of request) above target |
openshift-ingress |
replicaset-controller |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45 |
SuccessfulCreate |
Created pod: e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
Created |
Container created | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
Started |
Container started | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
AddedInterface |
Add eth0 [10.132.0.118/23] from ovn-kubernetes | |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
Unhealthy |
Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
ProbeError |
Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 2 to 1 |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-kj955 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-extmod-a-6ac03f-75c4d699fc-822x5 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-a-6ac03f-69955c8999-lgtmm |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-extmod-a-6ac03f-openshift-default-568485c58f-29fh2 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-8x92m |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-extmod-b-3a78b4-openshift-default-77b8648d45-z9lxp |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-extmod-b-3a78b4-6bdcd74b8c-44fkk |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-extmod-b-3a78b4-54f9b5d795-4c8q9 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
multus |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
AddedInterface |
Add eth0 [10.133.1.9/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
e2e-ait-c1934578-openshift-default-9fd49846f |
SuccessfulCreate |
Created pod: e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 | |
openshift-ingress |
gateway_labeler_controller |
e2e-ait-c1934578 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c1934578 | |
openshift-ingress |
deployment-controller |
e2e-ait-c1934578-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ait-c1934578-openshift-default-9fd49846f from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ait-c1934578 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ait-c1934578-7ccfdc97ff from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-c1934578-7ccfdc97ff |
FailedCreate |
Error creating: pods "payload-processing-e2e-ait-c1934578-7ccfdc97ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c1934578: serviceaccount "payload-processing-e2e-ait-c1934578" not found |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c1934578: serviceaccount "payload-processing-e2e-ait-c1934578" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-c1934578-7ccfdc97ff |
SuccessfulCreate |
Created pod: payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ait-c1934578 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ait-c1934578-5c588b5bdc from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb |
Started |
Container started | |
openshift-ingress |
multus |
payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 |
AddedInterface |
Add eth0 [10.133.1.11/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb |
AddedInterface |
Add eth0 [10.133.1.10/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
Started |
Container started |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
ProbeError |
Startup probe error: Get "http://10.133.1.9:15021/healthz/ready": dial tcp 10.133.1.9:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
Unhealthy |
Startup probe failed: Get "http://10.133.1.9:15021/healthz/ready": dial tcp 10.133.1.9:15021: connect: connection refused |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-c1934578-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-c1934578-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-c1934578-5c588b5bdc-s8gfb |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-c1934578-7ccfdc97ff-2phh8 |
Killing |
Stopping container payload-processing | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-c1934578-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ait-c1934578-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
kubelet |
e2e-ait-c1934578-openshift-default-9fd49846f-98hx4 |
Killing |
Stopping container istio-proxy | |
opendatahub |
replicaset-controller |
maas-controller-5975b94bc |
SuccessfulDelete |
Deleted pod: maas-controller-5975b94bc-pp42k | |
opendatahub |
kubelet |
maas-controller-5975b94bc-pp42k |
Killing |
Stopping container manager | |
opendatahub |
multus |
maas-controller-5975b94bc-2j9j5 |
AddedInterface |
Add eth0 [10.133.1.15/23] from ovn-kubernetes | |
opendatahub |
replicaset-controller |
maas-controller-5975b94bc |
SuccessfulCreate |
Created pod: maas-controller-5975b94bc-2j9j5 | |
opendatahub |
kubelet |
maas-controller-5975b94bc-2j9j5 |
Pulling |
Pulling image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" | |
opendatahub |
kubelet |
maas-controller-5975b94bc-2j9j5 |
Created |
Container created | |
opendatahub |
kubelet |
maas-controller-5975b94bc-2j9j5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" in 904ms (904ms including waiting). Image size: 200094741 bytes. | |
opendatahub |
kubelet |
maas-controller-5975b94bc-2j9j5 |
Started |
Container started | |
opendatahub |
maas-controller-5975b94bc-2j9j5_c856b582-9b72-48f0-851e-e36732d77428 |
maas-controller.models-as-a-service.opendatahub.io |
LeaderElection |
maas-controller-5975b94bc-2j9j5_c856b582-9b72-48f0-851e-e36732d77428 became leader | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
AddedInterface |
Add eth0 [10.133.1.17/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
AddedInterface |
Add eth0 [10.134.0.100/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-6dcf757899-ppqp4 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
AddedInterface |
Add eth0 [10.133.1.18/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Started |
Container started | |
opendatahub |
replicaset-controller |
maas-controller-5975b94bc |
SuccessfulDelete |
Deleted pod: maas-controller-5975b94bc-2j9j5 | |
| (x2) | opendatahub |
deployment-controller |
maas-controller |
ScalingReplicaSet |
Scaled down replica set maas-controller-5975b94bc from 1 to 0 |
opendatahub |
kubelet |
maas-controller-5975b94bc-2j9j5 |
Killing |
Stopping container manager | |
opendatahub |
replicaset-controller |
maas-controller-5975b94bc |
SuccessfulCreate |
Created pod: maas-controller-5975b94bc-gwv4h | |
| (x3) | opendatahub |
deployment-controller |
maas-controller |
ScalingReplicaSet |
Scaled up replica set maas-controller-5975b94bc from 0 to 1 |
opendatahub |
multus |
maas-controller-5975b94bc-gwv4h |
AddedInterface |
Add eth0 [10.133.1.19/23] from ovn-kubernetes | |
opendatahub |
kubelet |
maas-controller-5975b94bc-gwv4h |
Pulling |
Pulling image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
ProbeError |
Startup probe error: Get "http://10.133.1.17:15021/healthz/ready": dial tcp 10.133.1.17:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
ProbeError |
Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Unhealthy |
Startup probe failed: Get "http://10.133.1.17:15021/healthz/ready": dial tcp 10.133.1.17:15021: connect: connection refused |
opendatahub |
kubelet |
maas-controller-5975b94bc-gwv4h |
Started |
Container started | |
opendatahub |
kubelet |
maas-controller-5975b94bc-gwv4h |
Created |
Container created | |
opendatahub |
kubelet |
maas-controller-5975b94bc-gwv4h |
Pulled |
Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:0b4aa085e8631f861a1a2a681461ba85d6a16a2a8c172d5a27283a0b71e7d4bd" in 812ms (812ms including waiting). Image size: 200094741 bytes. | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
ProbeError |
Startup probe error: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Unhealthy |
Startup probe failed: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused |
opendatahub |
maas-controller-5975b94bc-gwv4h_ef8b571b-19ac-4dfa-a202-c7ebe730e009 |
maas-controller.models-as-a-service.opendatahub.io |
LeaderElection |
maas-controller-5975b94bc-gwv4h_ef8b571b-19ac-4dfa-a202-c7ebe730e009 became leader | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
AddedInterface |
Add eth0 [10.134.0.101/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
AddedInterface |
Add eth0 [10.132.0.121/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
AddedInterface |
Add eth0 [10.133.1.20/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
AddedInterface |
Add eth0 [10.132.0.122/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
ProbeError |
Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
ProbeError |
Startup probe error: Get "http://10.133.1.20:15021/healthz/ready": dial tcp 10.133.1.20:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
ProbeError |
Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
ProbeError |
Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
Unhealthy |
Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
Unhealthy |
Startup probe failed: Get "http://10.133.1.20:15021/healthz/ready": dial tcp 10.133.1.20:15021: connect: connection refused |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
ProbeError |
Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
ProbeError |
Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
Unhealthy |
Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
ProbeError |
Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
Unhealthy |
Startup probe failed: Get "http://10.133.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
ProbeError |
Startup probe error: Get "http://10.133.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
AddedInterface |
Add eth0 [10.132.0.123/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
AddedInterface |
Add eth0 [10.134.0.102/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
Started |
Container started | |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
ProbeError |
Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
ProbeError |
Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
ProbeError |
Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
ProbeError |
Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.Secret llm/e2e-prio-pool-b2fa3bcb-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.Deployment llm/e2e-prio-pool-b2fa3bcb-kserve | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
replicaset-controller |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889 |
SuccessfulCreate |
Created pod: e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.Service llm/e2e-prio-pool-b2fa3bcb-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.ServiceAccount llm/e2e-prio-pool-b2fa3bcb-epp-sa | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.ClusterRoleBinding /llm-e2e-prio-pool-b2fa3bcb-epp-auth-rb | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.Role llm/e2e-prio-pool-b2fa3bcb-epp-role | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.RoleBinding llm/e2e-prio-pool-b2fa3bcb-epp-rb | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.Deployment llm/e2e-prio-pool-b2fa3bcb-kserve-router-scheduler | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
Created v1.Service llm/e2e-prio-pool-b2fa3bcb-epp-service | |
llm |
deployment-controller |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889 from 0 to 1 | |
llm |
deployment-controller |
e2e-prio-pool-b2fa3bcb-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4 from 0 to 1 | |
llm |
multus |
e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn |
AddedInterface |
Add eth0 [10.133.1.24/23] from ovn-kubernetes | |
llm |
replicaset-controller |
e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4 |
SuccessfulCreate |
Created pod: e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn | |
llm |
multus |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
AddedInterface |
Add eth0 [10.133.1.25/23] from ovn-kubernetes | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn |
Started |
Container started | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn |
Created |
Container created | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 2.163s (2.163s including waiting). Image size: 184206420 bytes. | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
Started |
Container started | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
Created |
Container created | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Updated |
Updated v1.Secret llm/e2e-prio-pool-b2fa3bcb-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Error |
Reconciliation failed: failed to reconcile networking: failed to reconcile HTTP routes: failed to reconcile HTTPRoute llm/e2e-prio-pool-b2fa3bcb-kserve-route: failed to update v1.HTTPRoute llm/e2e-prio-pool-b2fa3bcb-kserve-route: Operation cannot be fulfilled on httproutes.gateway.networking.k8s.io "e2e-prio-pool-b2fa3bcb-kserve-route": the object has been modified; please apply your changes to the latest version and try again | |
| (x9) | llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Created |
(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-b2fa3bcb-kserve-shadow-svc |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Updated |
Updated v1.HTTPRoute llm/e2e-prio-pool-b2fa3bcb-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
LLMInferenceServiceReady |
LLMInferenceService [e2e-prio-pool-b2fa3bcb] is Ready | |
llm |
LLMInferenceServiceController |
e2e-prio-pool-b2fa3bcb |
Deleted |
Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-b2fa3bcb-epp-auth-rb | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
Killing |
Stopping container main | |
llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-7c78cd7cc4-sjtbn |
Killing |
Stopping container main | |
openshift-ingress |
replicaset-controller |
e2e-worker-single-main-62ca10-openshift-default-659b69975c |
SuccessfulCreate |
Created pod: e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 | |
openshift-ingress |
deployment-controller |
e2e-worker-single-main-62ca10-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-single-main-62ca10-openshift-default-659b69975c from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-worker-single-main-62ca10 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-62ca10 | |
openshift-ingress |
multus |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
AddedInterface |
Add eth0 [10.132.0.126/23] from ovn-kubernetes | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9646c |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9646c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-62ca10: serviceaccount "payload-processing-e2e-worker-single-main-62ca10" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-worker-single-main-62ca10 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-worker-single-main-62ca10-5bd99fd49 from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49 |
FailedCreate |
Error creating: pods "payload-processing-e2e-worker-single-main-62ca10-5bd99fd49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-62ca10: serviceaccount "payload-processing-e2e-worker-single-main-62ca10" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-worker-single-main-62ca10 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9646c from 0 to 1 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np |
AddedInterface |
Add eth0 [10.132.0.127/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9646c |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49 |
SuccessfulCreate |
Created pod: payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk |
AddedInterface |
Add eth0 [10.132.0.128/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk |
Created |
Container created | |
| (x5) | llm |
kubelet |
e2e-prio-pool-b2fa3bcb-kserve-router-scheduler-757fc8b889-d6xf4 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-62ca10-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-62ca10-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
ProbeError |
Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body: |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-62ca10-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-62ca10-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np |
Killing |
Stopping container payload-pre-processing | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-62ca10-5bd99fd49l7vlk |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-62ca10-5ffff9p6np |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-worker-single-main-62ca10-openshift-default-659b69975cbxnn6 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
llm |
replicaset-controller |
e2e-same-id-a-128a019f-kserve-64d4bbd977 |
SuccessfulCreate |
Created pod: e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.Secret llm/e2e-same-id-a-128a019f-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.Deployment llm/e2e-same-id-a-128a019f-kserve | |
llm |
deployment-controller |
e2e-same-id-a-128a019f-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-same-id-a-128a019f-kserve-64d4bbd977 from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.PodMonitor llm/e2e-same-id-a-128a019f-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.Service llm/e2e-same-id-a-128a019f-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.HTTPRoute llm/e2e-same-id-a-128a019f-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.DestinationRule llm/e2e-same-id-a-128a019f-kserve-workload-svc | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.PodMonitor llm/e2e-same-id-a-128a019f-kserve-llmisvc-engine-default | |
llm |
kubelet |
e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg |
Started |
Container started | |
llm |
kubelet |
e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg |
Created |
Container created | |
llm |
kubelet |
e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
multus |
e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg |
AddedInterface |
Add eth0 [10.132.0.131/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Created |
Created v1.NetworkPolicy llm/e2e-same-id-a-128a019f-prometheus-scraping | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
Updated |
Updated v1.Secret llm/e2e-same-id-a-128a019f-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
LLMInferenceServiceReady |
LLMInferenceService [e2e-same-id-a-128a019f] is Ready | |
llm |
deployment-controller |
e2e-same-id-b-128a019f-kserve |
ScalingReplicaSet |
Scaled up replica set e2e-same-id-b-128a019f-kserve-8758f7f8f from 0 to 1 | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.Service llm/e2e-same-id-b-128a019f-kserve-workload-svc | |
llm |
replicaset-controller |
e2e-same-id-b-128a019f-kserve-8758f7f8f |
SuccessfulCreate |
Created pod: e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.Secret llm/e2e-same-id-b-128a019f-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.Deployment llm/e2e-same-id-b-128a019f-kserve | |
llm |
kubelet |
e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.HTTPRoute llm/e2e-same-id-b-128a019f-kserve-route | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.PodMonitor llm/e2e-same-id-b-128a019f-kserve-llmisvc-engine-default | |
llm |
kubelet |
e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c |
Started |
Container started | |
llm |
multus |
e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c |
AddedInterface |
Add eth0 [10.133.1.29/23] from ovn-kubernetes | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.DestinationRule llm/e2e-same-id-b-128a019f-kserve-workload-svc | |
llm |
kubelet |
e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c |
Created |
Container created | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.PodMonitor llm/e2e-same-id-b-128a019f-kserve-llmisvc-engine | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Created |
Created v1.NetworkPolicy llm/e2e-same-id-b-128a019f-prometheus-scraping | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
Updated |
Updated v1.Secret llm/e2e-same-id-b-128a019f-kserve-self-signed-certs | |
llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
LLMInferenceServiceReady |
LLMInferenceService [e2e-same-id-b-128a019f] is Ready | |
| (x3) | llm |
LLMInferenceServiceController |
e2e-same-id-a-128a019f |
ModelNameCollision |
model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-128a019f in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-128a019f; safe to ignore if traffic splitting is planned |
| (x5) | llm |
LLMInferenceServiceController |
e2e-same-id-b-128a019f |
ModelNameCollision |
model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-128a019f in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-128a019f; safe to ignore if traffic splitting is planned |
llm |
kubelet |
e2e-same-id-a-128a019f-kserve-64d4bbd977-4blgg |
Killing |
Stopping container main | |
llm |
kubelet |
e2e-same-id-b-128a019f-kserve-8758f7f8f-dqm9c |
Killing |
Stopping container main | |
openshift-ingress |
gateway_labeler_controller |
e2e-ipp-a-1e6e34 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-1e6e34 | |
openshift-ingress |
replicaset-controller |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc |
SuccessfulCreate |
Created pod: e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z | |
openshift-ingress |
deployment-controller |
e2e-ipp-a-1e6e34-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc from 0 to 1 | |
openshift-ingress |
multus |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
AddedInterface |
Add eth0 [10.133.1.33/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf |
FailedCreate |
Error creating: pods "payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1e6e34: serviceaccount "payload-processing-e2e-ipp-a-1e6e34" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ipp-a-1e6e34 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ipp-a-1e6e34-5c87746cbf from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ipp-a-1e6e34 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf |
SuccessfulCreate |
Created pod: payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1e6e34: serviceaccount "payload-processing-e2e-ipp-a-1e6e34" not found |
openshift-ingress |
multus |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l |
AddedInterface |
Add eth0 [10.133.1.34/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l |
Started |
Container started | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff |
AddedInterface |
Add eth0 [10.133.1.35/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-5c87746cbf-jnk6l |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-d9bdd6775-cxnff |
Started |
Container started | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ipp-a-1e6e34 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ipp-a-1e6e34 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6 from 0 to 1 | |
| (x9) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6 |
FailedCreate |
Error creating: pods "payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1e6e34: serviceaccount "payload-processing-e2e-ipp-a-1e6e34" not found |
| (x8) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1e6e34: serviceaccount "payload-processing-e2e-ipp-a-1e6e34" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6 |
SuccessfulCreate |
Created pod: payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w |
AddedInterface |
Add eth0 [10.133.1.36/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" | |
openshift-ingress |
multus |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds |
AddedInterface |
Add eth0 [10.133.1.37/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.872s (2.872s including waiting). Image size: 166620835 bytes. | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.054s (2.054s including waiting). Image size: 166620835 bytes. | |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
Started |
Container started |
| (x6) | openshift-ingress |
kubelet |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
Unhealthy |
Startup probe failed: Get "http://10.133.1.33:15021/healthz/ready": dial tcp 10.133.1.33:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
ProbeError |
Startup probe error: Get "http://10.133.1.33:15021/healthz/ready": dial tcp 10.133.1.33:15021: connect: connection refused body: |
openshift-ingress |
replicaset-controller |
e2e-ipp-b-193883-openshift-default-9d786df8f |
SuccessfulCreate |
Created pod: e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh | |
openshift-ingress |
deployment-controller |
e2e-ipp-b-193883-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ipp-b-193883-openshift-default-9d786df8f from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-ipp-b-193883 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-193883 | |
openshift-ingress |
multus |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
AddedInterface |
Add eth0 [10.132.0.133/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ipp-b-193883 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ipp-b-193883-5997b8d56c from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ipp-b-193883 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ipp-b-193883-748669b78c from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-b-193883-5997b8d56c |
FailedCreate |
Error creating: pods "payload-processing-e2e-ipp-b-193883-5997b8d56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-193883: serviceaccount "payload-processing-e2e-ipp-b-193883" not found |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-b-193883-748669b78c |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ipp-b-193883-748669b78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-193883: serviceaccount "payload-processing-e2e-ipp-b-193883" not found |
openshift-ingress |
multus |
payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb |
AddedInterface |
Add eth0 [10.133.1.38/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-b-193883-748669b78c |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-b-193883-5997b8d56c |
SuccessfulCreate |
Created pod: payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-5997b8d56c-nkmrb |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 |
Created |
Container created | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 |
AddedInterface |
Add eth0 [10.134.0.103/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-748669b78c-gsnv6 |
Killing |
Stopping container payload-pre-processing | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ipp-a-1e6e34-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ipp-a-1e6e34-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ipp-b-193883 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ipp-b-193883-565df96f5 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ipp-b-193883 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ipp-b-193883-66f8d96c44 from 0 to 1 | |
| (x9) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-b-193883-66f8d96c44 |
FailedCreate |
Error creating: pods "payload-processing-e2e-ipp-b-193883-66f8d96c44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-193883: serviceaccount "payload-processing-e2e-ipp-b-193883" not found |
| (x8) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-b-193883-565df96f5 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ipp-b-193883-565df96f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-193883: serviceaccount "payload-processing-e2e-ipp-b-193883" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-b-193883-66f8d96c44 |
SuccessfulCreate |
Created pod: payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq |
AddedInterface |
Add eth0 [10.133.1.39/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-b-193883-565df96f5 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq | |
openshift-ingress |
multus |
payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 |
AddedInterface |
Add eth0 [10.133.1.40/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 |
Created |
Container created | |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
ProbeError |
Readiness probe error: Get "http://10.132.0.133:15021/healthz/ready": read tcp 10.132.0.2:47164->10.132.0.133:15021: read: connection reset by peer body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
Created |
Container created |
openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.133:15021/healthz/ready": read tcp 10.132.0.2:47164->10.132.0.133:15021: read: connection reset by peer | |
| (x5) | openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
ProbeError |
Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
Unhealthy |
Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused |
| (x5) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ipp-b-193883-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-ipp-b-193883-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-1e6e34-7bdd688bb6-8bwds |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-1e6e34-6cf4c5b4bc-gg55w |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-ipp-a-1e6e34-openshift-default-6f5755c8dc-fsr7z |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-193883-66f8d96c44-z48c2 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-193883-565df96f5-n5jfq |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-ipp-b-193883-openshift-default-9d786df8f-9pffh |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-58769f698d from 0 to 1 | |
openshift-ingress |
kubelet |
payload-pre-processing-58769f698d-9hnjj |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-58769f698d-9hnjj |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-58769f698d-9hnjj |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-58769f698d |
SuccessfulCreate |
Created pod: payload-pre-processing-58769f698d-9hnjj | |
openshift-ingress |
multus |
payload-pre-processing-58769f698d-9hnjj |
AddedInterface |
Add eth0 [10.133.1.42/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-7b98bb678c |
SuccessfulDelete |
Deleted pod: payload-pre-processing-7b98bb678c-hf7lc | |
openshift-ingress |
kubelet |
payload-pre-processing-7b98bb678c-hf7lc |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
multus |
payload-processing-5d8fcd46d4-q24jg |
AddedInterface |
Add eth0 [10.133.1.43/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-5d8fcd46d4 |
SuccessfulCreate |
Created pod: payload-processing-5d8fcd46d4-q24jg | |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled up replica set payload-processing-5d8fcd46d4 from 0 to 1 | |
openshift-ingress |
kubelet |
payload-processing-5d8fcd46d4-q24jg |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-5d8fcd46d4-q24jg |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-5d8fcd46d4-q24jg |
Started |
Container started | |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0 | |
openshift-ingress |
replicaset-controller |
payload-processing-55fbbbf9dc |
SuccessfulDelete |
Deleted pod: payload-processing-55fbbbf9dc-z7qfl | |
openshift-ingress |
kubelet |
payload-processing-55fbbbf9dc-z7qfl |
Killing |
Stopping container payload-processing | |
openshift-ingress |
multus |
payload-processing-656dd59d89-ml7g4 |
AddedInterface |
Add eth0 [10.133.1.44/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-656dd59d89-ml7g4 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-pre-processing-69b46c5574-d6tqb |
AddedInterface |
Add eth0 [10.133.1.45/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-69b46c5574 |
SuccessfulCreate |
Created pod: payload-pre-processing-69b46c5574-d6tqb | |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-69b46c5574 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-656dd59d89 |
SuccessfulCreate |
Created pod: payload-processing-656dd59d89-ml7g4 | |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled up replica set payload-processing-656dd59d89 from 0 to 1 | |
openshift-ingress |
kubelet |
payload-processing-656dd59d89-ml7g4 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-656dd59d89-ml7g4 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-69b46c5574-d6tqb |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-69b46c5574-d6tqb |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-69b46c5574-d6tqb |
Created |
Container created | |
openshift-ingress |
replicaset-controller |
payload-processing-5d8fcd46d4 |
SuccessfulDelete |
Deleted pod: payload-processing-5d8fcd46d4-q24jg | |
openshift-ingress |
kubelet |
payload-processing-5d8fcd46d4-q24jg |
Killing |
Stopping container payload-processing | |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled down replica set payload-processing-5d8fcd46d4 from 1 to 0 | |
openshift-ingress |
kubelet |
payload-pre-processing-58769f698d-9hnjj |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-58769f698d |
SuccessfulDelete |
Deleted pod: payload-pre-processing-58769f698d-9hnjj | |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled down replica set payload-pre-processing-58769f698d from 1 to 0 | |
models-as-a-service |
deployment-controller |
payload-processing-external-model |
ScalingReplicaSet |
Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1 | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 8; reason: All metrics below target | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-r8lg8 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-r8lg8 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gqnt |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-8gqnt | |
| (x8) | models-as-a-service |
replicaset-controller |
payload-processing-external-model-5bcd7997 |
FailedCreate |
Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 10 to 8 | |
models-as-a-service |
replicaset-controller |
payload-processing-external-model-5bcd7997 |
SuccessfulCreate |
Created pod: payload-processing-external-model-5bcd7997-x2xm2 | |
models-as-a-service |
multus |
payload-processing-external-model-5bcd7997-x2xm2 |
AddedInterface |
Add eth0 [10.133.1.46/23] from ovn-kubernetes | |
models-as-a-service |
kubelet |
payload-processing-external-model-5bcd7997-x2xm2 |
Created |
Container created | |
models-as-a-service |
kubelet |
payload-processing-external-model-5bcd7997-x2xm2 |
Started |
Container started | |
models-as-a-service |
kubelet |
payload-processing-external-model-5bcd7997-x2xm2 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
ProbeError |
Readiness probe error: Get "http://10.133.1.17:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.17:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
ProbeError |
Readiness probe error: Get "http://10.133.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 8 to 4 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Killing |
Stopping container istio-proxy | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 4; reason: All metrics below target |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-ppqp4 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-tbpd6 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-8gm95 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7xbnw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-ppqp4 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
AddedInterface |
Add eth0 [10.133.1.48/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 4 to 8 |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
AddedInterface |
Add eth0 [10.132.0.135/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
AddedInterface |
Add eth0 [10.134.0.105/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 8; reason: cpu resource utilization (percentage of request) above target |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
AddedInterface |
Add eth0 [10.133.1.49/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
Created |
Container created | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
Unhealthy |
Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
ProbeError |
Startup probe error: Get "http://10.133.1.49:15021/healthz/ready": dial tcp 10.133.1.49:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
ProbeError |
Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
ProbeError |
Startup probe error: Get "http://10.133.1.48:15021/healthz/ready": dial tcp 10.133.1.48:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
Unhealthy |
Startup probe failed: Get "http://10.133.1.48:15021/healthz/ready": dial tcp 10.133.1.48:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
Unhealthy |
Startup probe failed: Get "http://10.133.1.49:15021/healthz/ready": dial tcp 10.133.1.49:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
Unhealthy |
Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
ProbeError |
Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body: |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
AddedInterface |
Add eth0 [10.134.0.106/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
AddedInterface |
Add eth0 [10.132.0.136/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 8 to 10 |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 10; reason: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
Started |
Container started | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
Unhealthy |
Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
ProbeError |
Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
ProbeError |
Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
Unhealthy |
Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused |
models-as-a-service |
kubelet |
payload-processing-external-model-5bcd7997-x2xm2 |
Killing |
Stopping container payload-processing | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
ProbeError |
Readiness probe error: Get "http://10.132.0.123:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
ProbeError |
Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
openshift-ingress |
deployment-controller |
e2e-worker-single-main-7ddf45-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-worker-single-main-7ddf45-openshift-default-7db587fc85 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85 |
SuccessfulCreate |
Created pod: e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml | |
openshift-ingress |
gateway_labeler_controller |
e2e-worker-single-main-7ddf45 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-7ddf45 | |
openshift-ingress |
multus |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
AddedInterface |
Add eth0 [10.133.1.65/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c |
FailedCreate |
Error creating: pods "payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7ddf45: serviceaccount "payload-processing-e2e-worker-single-main-7ddf45" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-worker-single-main-7ddf45 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-worker-single-main-7ddf45 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c |
SuccessfulCreate |
Created pod: payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7ddf45: serviceaccount "payload-processing-e2e-worker-single-main-7ddf45" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh |
Started |
Container started | |
openshift-ingress |
multus |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 |
AddedInterface |
Add eth0 [10.133.1.66/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh |
AddedInterface |
Add eth0 [10.132.0.137/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 |
Started |
Container started | |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
Started |
Container started |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-7ddf45-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-7ddf45-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
Unhealthy |
Startup probe failed: Get "http://10.133.1.65:15021/healthz/ready": dial tcp 10.133.1.65:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
ProbeError |
Startup probe error: Get "http://10.133.1.65:15021/healthz/ready": dial tcp 10.133.1.65:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 |
Killing |
Stopping container payload-pre-processing | |
| (x2) | openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6xvrlh |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887852k2 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
openshift-ingress |
deployment-controller |
payload-processing-e2e-worker-single-main-7ddf45 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7ddf45: serviceaccount "payload-processing-e2e-worker-single-main-7ddf45" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-worker-single-main-7ddf45 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7 from 0 to 1 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c |
FailedCreate |
Error creating: pods "payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7ddf45: serviceaccount "payload-processing-e2e-worker-single-main-7ddf45" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd6c |
SuccessfulCreate |
Created pod: payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d8875dd7 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm |
Started |
Container started | |
openshift-ingress |
multus |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm |
AddedInterface |
Add eth0 [10.133.1.70/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 |
AddedInterface |
Add eth0 [10.133.1.69/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-worker-single-main-7ddf45-5d887486d4 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-worker-single-main-7ddf45-567b8bfd668dzm |
Killing |
Stopping container payload-processing | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-7ddf45-openshift-default |
FailedUpdateStatus |
horizontalpodautoscalers.autoscaling "e2e-worker-single-main-7ddf45-openshift-default" not found | |
openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
Killing |
Stopping container istio-proxy | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-7ddf45-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-worker-single-main-7ddf45-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-worker-single-main-7ddf45-openshift-default-7db587fc85mjkml |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
ProbeError |
Readiness probe error: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
ProbeError |
Readiness probe error: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
ProbeError |
Readiness probe error: Get "http://10.133.1.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
ProbeError |
Readiness probe error: Get "http://10.133.1.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
ProbeError |
Readiness probe error: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-7wrsc |
Killing |
Stopping container manager | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0 | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-678d87766f |
SuccessfulDelete |
Deleted pod: kuadrant-operator-controller-manager-678d87766f-7wrsc | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
AllRequirementsMet |
all requirements found, attempting install |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-678d87766f |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-678d87766f-bsm7c | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
NeedsReinstall |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallSucceeded |
waiting for install components to report healthy |
| (x2) | kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1 |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-bsm7c |
Pulled |
Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-678d87766f-bsm7c |
AddedInterface |
Add eth0 [10.132.0.140/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
ComponentUnhealthy |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-bsm7c |
Created |
Container created | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-678d87766f-bsm7c |
Started |
Container started | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.3 |
InstallSucceeded |
install strategy completed with no errors |
kuadrant-system |
kuadrant-operator-controller-manager-678d87766f-bsm7c_1e6b8fef-1015-4642-88f8-671b04581dff |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-678d87766f-bsm7c_1e6b8fef-1015-4642-88f8-671b04581dff became leader | |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
ProbeError |
Readiness probe error: Get "http://10.134.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-pjqbs | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-bp4h7 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-bp4h7 | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled down replica set maas-default-gateway-openshift-default-6dcf757899 from 10 to 1 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2z9c |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-qzbzn |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-d9wv2 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pjqbs |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-zfkls |
Killing |
Stopping container istio-proxy | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 1; reason: All metrics below target |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-t2z9c | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-6dcf757899 |
SuccessfulDelete |
Deleted pod: maas-default-gateway-openshift-default-6dcf757899-qzbzn | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-7hsh2 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-wkxz9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
ProbeError |
Readiness probe error: Get "http://10.134.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-l2zvm |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 1 to 4 |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 4; reason: cpu resource utilization (percentage of request) above target |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
AddedInterface |
Add eth0 [10.132.0.143/23] from ovn-kubernetes | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
AddedInterface |
Add eth0 [10.133.1.78/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
AddedInterface |
Add eth0 [10.134.0.108/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
Started |
Container started | |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
ProbeError |
Startup probe error: Get "http://10.133.1.78:15021/healthz/ready": dial tcp 10.133.1.78:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
Unhealthy |
Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
ProbeError |
Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
Unhealthy |
Startup probe failed: Get "http://10.133.1.78:15021/healthz/ready": dial tcp 10.133.1.78:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
ProbeError |
Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
AddedInterface |
Add eth0 [10.134.0.109/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
Started |
Container started | |
openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 6; reason: All metrics below target | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
Started |
Container started | |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 4 to 6 | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
AddedInterface |
Add eth0 [10.132.0.144/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
ProbeError |
Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body: |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
ProbeError |
Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
maas-default-gateway-openshift-default |
SuccessfulRescale |
New size: 10; reason: cpu resource utilization (percentage of request) above target |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-6dcf757899 from 6 to 10 | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
Started |
Container started | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
AddedInterface |
Add eth0 [10.133.1.81/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
Created |
Container created | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
AddedInterface |
Add eth0 [10.134.0.110/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
AddedInterface |
Add eth0 [10.132.0.145/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
Created |
Container created | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
Started |
Container started | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
AddedInterface |
Add eth0 [10.133.1.80/23] from ovn-kubernetes | |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
Unhealthy |
Startup probe failed: Get "http://10.133.1.81:15021/healthz/ready": dial tcp 10.133.1.81:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
ProbeError |
Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
Unhealthy |
Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
Unhealthy |
Startup probe failed: Get "http://10.133.1.80:15021/healthz/ready": dial tcp 10.133.1.80:15021: connect: connection refused |
| (x8) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
ProbeError |
Startup probe error: Get "http://10.133.1.80:15021/healthz/ready": dial tcp 10.133.1.80:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
ProbeError |
Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body: |
| (x7) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
ProbeError |
Startup probe error: Get "http://10.133.1.81:15021/healthz/ready": dial tcp 10.133.1.81:15021: connect: connection refused body: |
openshift-ingress |
gateway_labeler_controller |
e2e-mt-8869c0de |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8869c0de | |
openshift-ingress |
replicaset-controller |
e2e-mt-8869c0de-openshift-default-56fcb59f45 |
SuccessfulCreate |
Created pod: e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv | |
openshift-ingress |
deployment-controller |
e2e-mt-8869c0de-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-mt-8869c0de-openshift-default-56fcb59f45 from 0 to 1 | |
openshift-ingress |
multus |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
AddedInterface |
Add eth0 [10.133.1.82/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 | |
| (x7) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-8869c0de-bf7df7f85 |
FailedCreate |
Error creating: pods "payload-processing-e2e-mt-8869c0de-bf7df7f85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8869c0de: serviceaccount "payload-processing-e2e-mt-8869c0de" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-mt-8869c0de |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-mt-8869c0de-bf7df7f85 from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-mt-8869c0de-7679b957dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8869c0de: serviceaccount "payload-processing-e2e-mt-8869c0de" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-8869c0de-bf7df7f85 |
SuccessfulCreate |
Created pod: payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-mt-8869c0de |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-mt-8869c0de-7679b957dc from 0 to 1 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 |
AddedInterface |
Add eth0 [10.133.1.83/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 |
Started |
Container started | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 |
Created |
Container created | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 |
Pulled |
Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod | |
openshift-ingress |
multus |
payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 |
AddedInterface |
Add eth0 [10.133.1.84/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 |
Created |
Container created | |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
Created |
Container created |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
Started |
Container started |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-8869c0de-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-8869c0de-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x5) | openshift-ingress |
kubelet |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
Unhealthy |
Startup probe failed: Get "http://10.133.1.82:15021/healthz/ready": dial tcp 10.133.1.82:15021: connect: connection refused |
| (x5) | openshift-ingress |
kubelet |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
ProbeError |
Startup probe error: Get "http://10.133.1.82:15021/healthz/ready": dial tcp 10.133.1.82:15021: connect: connection refused body: |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-8869c0de-openshift-default |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
e2e-mt-8869c0de-openshift-default |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-8869c0de-bf7df7f85-zwjd6 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-8869c0de-7679b957dc-m6nv8 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-mt-8869c0de-openshift-default-56fcb59f45-8qgnv |
Killing |
Stopping container istio-proxy | |
| (x5) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-mc2nj |
ProbeError |
Readiness probe error: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
ProbeError |
Readiness probe error: Get "http://10.133.1.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
ProbeError |
Readiness probe error: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-pk25x |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-5cmc8 |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-z6h47 |
ProbeError |
Readiness probe error: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-t2q27 |
ProbeError |
Readiness probe error: Get "http://10.132.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-dghm7 |
ProbeError |
Readiness probe error: Get "http://10.133.1.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-547v7 |
ProbeError |
Readiness probe error: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
ProbeError |
Readiness probe error: Get "http://10.133.1.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x3) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cnggl |
Unhealthy |
Readiness probe failed: Get "http://10.133.1.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-cn28r |
ProbeError |
Readiness probe error: Get "http://10.134.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |
| (x6) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-6dcf757899-gt29z |
ProbeError |
Readiness probe error: Get "http://10.133.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: |