Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb to ip-10-0-129-146.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-tpxsw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-tpxsw to ip-10-0-128-85.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-r8ft2

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r8ft2 to ip-10-0-128-85.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-svcsn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-svcsn to ip-10-0-128-85.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-59b57f6f78-2lkkd to ip-10-0-128-85.ec2.internal

opendatahub

odh-model-controller-769875db56-8jrxh

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-8jrxh to ip-10-0-128-85.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-swf6j

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-swf6j to ip-10-0-136-38.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-xcv5v

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-xcv5v to ip-10-0-128-85.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-59b57f6f78-g9k4n to ip-10-0-129-146.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-59b57f6f78-t48hs to ip-10-0-136-38.ec2.internal

opendatahub

maas-controller-7cb76cfbb6-fkcm7

Scheduled

Successfully assigned opendatahub/maas-controller-7cb76cfbb6-fkcm7 to ip-10-0-128-85.ec2.internal

opendatahub

maas-controller-6f6b55dfc4-hv5c5

Scheduled

Successfully assigned opendatahub/maas-controller-6f6b55dfc4-hv5c5 to ip-10-0-128-85.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-krsk7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-krsk7 to ip-10-0-129-146.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-649697ffd5j9s7t

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5j9s7t to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv to ip-10-0-136-38.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-srchd

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-srchd to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm to ip-10-0-129-146.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-4xfjh

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-4xfjh to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg to ip-10-0-129-146.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-j6f7m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-j6f7m to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55 to ip-10-0-128-85.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-q94rt

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-q94rt to ip-10-0-128-85.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-f556s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-f556s to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p to ip-10-0-128-85.ec2.internal

kuadrant-system

authorino-65db9f99d7-q88q2

Scheduled

Successfully assigned kuadrant-system/authorino-65db9f99d7-q88q2 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2 to ip-10-0-129-146.ec2.internal

kuadrant-system

authorino-74ccc46849-slwk7

Scheduled

Successfully assigned kuadrant-system/authorino-74ccc46849-slwk7 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9 to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f97668b9-65c448566d-bkh29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f97668b9-65c448566d-bkh29 to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8 to ip-10-0-136-38.ec2.internal

kuadrant-system

authorino-7597569d74-c9hhs

Scheduled

Successfully assigned kuadrant-system/authorino-7597569d74-c9hhs to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6 to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq to ip-10-0-128-85.ec2.internal

kuadrant-system

authorino-8468f79957-dxp8f

Scheduled

Successfully assigned kuadrant-system/authorino-8468f79957-dxp8f to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4 to ip-10-0-136-38.ec2.internal

kuadrant-system

authorino-8687494d7b-rpm8k

Scheduled

Successfully assigned kuadrant-system/authorino-8687494d7b-rpm8k to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-d4fgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-d4fgq to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5 to ip-10-0-136-38.ec2.internal

kuadrant-system

authorino-d675dcc65-fj2qz

Scheduled

Successfully assigned kuadrant-system/authorino-d675dcc65-fj2qz to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9 to ip-10-0-136-38.ec2.internal

kuadrant-system

authorino-dc8775675-wnqnl

Scheduled

Successfully assigned kuadrant-system/authorino-dc8775675-wnqnl to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9 to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847 to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s to ip-10-0-129-146.ec2.internal

kuadrant-system

authorino-operator-779bff956b-4cdnx

Scheduled

Successfully assigned kuadrant-system/authorino-operator-779bff956b-4cdnx to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg to ip-10-0-136-38.ec2.internal

kuadrant-system

developer-portal-controller-66d8dbb8c8-b2ll6

Scheduled

Successfully assigned kuadrant-system/developer-portal-controller-66d8dbb8c8-b2ll6 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs to ip-10-0-128-85.ec2.internal

kuadrant-system

dns-operator-controller-manager-57f5c66455-wqzgt

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-57f5c66455-wqzgt to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg to ip-10-0-128-85.ec2.internal

kuadrant-system

kuadrant-console-plugin-7bbc6bb9d7-92hd8

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-7bbc6bb9d7-92hd8 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5 to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9 to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2 to ip-10-0-129-146.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-zthg8

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-6b575997cc-zthg8 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4 to ip-10-0-136-38.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-bhd4j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-bhd4j to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4 to ip-10-0-136-38.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-b4jg2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-b4jg2 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq to ip-10-0-136-38.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-9xmcs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-9xmcs to ip-10-0-136-38.ec2.internal

kuadrant-system

limitador-limitador-77dd99c685-2wwlg

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-77dd99c685-2wwlg to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-4trvs to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-dkstw to ip-10-0-129-146.ec2.internal

kuadrant-system

limitador-limitador-f7d6b5c7c-7sl7d

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-f7d6b5c7c-7sl7d to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-pntbr to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds to ip-10-0-136-38.ec2.internal

kuadrant-system

limitador-operator-controller-manager-68669df9c4-ktqlt

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-68669df9c4-ktqlt to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6 to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl to ip-10-0-129-146.ec2.internal

kuadrant-system

mcp-gateway-controller-6c98b995c5-kczzc

Scheduled

Successfully assigned kuadrant-system/mcp-gateway-controller-6c98b995c5-kczzc to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k to ip-10-0-136-38.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-9cw8s

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-9cw8s to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628 to ip-10-0-128-85.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-zz6dk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-zz6dk to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5 to ip-10-0-129-146.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7 to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5 to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4 to ip-10-0-136-38.ec2.internal

opendatahub

odh-model-controller-769875db56-dq4xb

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-dq4xb to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8 to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp to ip-10-0-128-85.ec2.internal

cert-manager

cert-manager-597b95cb84-jcqw2

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-jcqw2 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt to ip-10-0-129-146.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-xnbks to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx to ip-10-0-129-146.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-fqldg to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w to ip-10-0-128-85.ec2.internal

openshift-ingress

kube-auth-proxy-64545848b5-gp7tk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-64545848b5-gp7tk to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c to ip-10-0-129-146.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-tbk7p to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298 to ip-10-0-136-38.ec2.internal

openshift-ingress

kube-auth-proxy-64545848b5-ffqsz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-64545848b5-ffqsz to ip-10-0-136-38.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-f5cm2

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-f5cm2 to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7 to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49 to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

Scheduled

Successfully assigned openshift-ingress/e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc to ip-10-0-129-146.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp to ip-10-0-128-85.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l to ip-10-0-129-146.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-zlz8n to ip-10-0-128-85.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wrfmq to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2 to ip-10-0-136-38.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v to ip-10-0-128-85.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-zqhtx

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-zqhtx to ip-10-0-136-38.ec2.internal

openshift-ingress

router-default-6d4df84b7f-nm9mn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-6d4df84b7f-nm9mn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-6d4df84b7f-nm9mn

Scheduled

Successfully assigned openshift-ingress/router-default-6d4df84b7f-nm9mn to ip-10-0-129-146.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-g8rvj to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9ae129-openshift-default-65fc746555-g28qc to ip-10-0-128-85.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-tz6f5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-tz6f5 to ip-10-0-129-146.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-bbmrg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbmrg to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg to ip-10-0-136-38.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-x26s8

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-x26s8 to ip-10-0-129-146.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-xpzqc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-xpzqc to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-a-f6171d-openshift-default-64847464f9-pxmhg

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f6171d-openshift-default-64847464f9-s44m2 to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9 to ip-10-0-128-85.ec2.internal

opendatahub

ai-gateway-controller-767df45bdd-6djqs

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-767df45bdd-6djqs to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc to ip-10-0-129-146.ec2.internal

openshift-jobset-operator

jobset-controller-manager-64db8fcdf6-qnr64

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-64db8fcdf6-qnr64 to ip-10-0-129-146.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79 to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg to ip-10-0-136-38.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-sdx9c

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-sdx9c to ip-10-0-136-38.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5 to ip-10-0-129-146.ec2.internal

openshift-ingress

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-301fcc-openshift-default-767d445955-5mlgj to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl to ip-10-0-128-85.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j to ip-10-0-129-146.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-trj5g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-trj5g to ip-10-0-129-146.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h to ip-10-0-136-38.ec2.internal

openshift-ingress

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68 to ip-10-0-136-38.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6d4df84b7f from 0 to 1

openshift-ingress

replicaset-controller

router-default-6d4df84b7f

SuccessfulCreate

Created pod: router-default-6d4df84b7f-nm9mn
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-6d4df84b7f-nm9mn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-6d4df84b7f-nm9mn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x3)

openshift-ingress

kubelet

router-default-6d4df84b7f-nm9mn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6d4df84b7f-nm9mn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-6d4df84b7f-nm9mn

Created

Container created

openshift-ingress

kubelet

router-default-6d4df84b7f-nm9mn

Started

Container started

openshift-ingress

multus

router-default-6d4df84b7f-nm9mn

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-xpzqc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpzqc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-xpzqc

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpzqc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.566s (2.566s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpzqc

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpzqc

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpzqc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpzqc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-f556s

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-64dd656c99

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-64dd656c99 from 0 to 1

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-f556s

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.211s (6.211s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-q6wwv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.651s (6.651s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-59b57f6f78

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-59b57f6f78-t48hs

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-59b57f6f78 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-59b57f6f78

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-59b57f6f78-g9k4n

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-59b57f6f78

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-59b57f6f78-2lkkd

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-59b57f6f78-t48hs

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.682s (2.682s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.68s (2.68s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.828s (2.828s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-59b57f6f78-t48hs_c2e7ee3c-c46a-4e6d-88f0-6afeb82bb151

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-59b57f6f78-t48hs_c2e7ee3c-c46a-4e6d-88f0-6afeb82bb151 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 415ms (415ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 296ms (296ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-2lkkd

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-g9k4n

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 331ms (331ms including waiting). Image size: 273709574 bytes.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-bcwq7

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-sdx9c
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-sdx9c

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: waiting for spec update of deployment "jobset-operator" to be observed...

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-sdx9c

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-sdx9c

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-sdx9c

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.01s (2.01s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-sdx9c

Created

Container created

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-swf6j

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-swf6j

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-swf6j

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-sdx9c_c0e00762-4ff4-4300-82f2-b14b93e3d46f became leader

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-swf6j

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.918s (2.918s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-swf6j

Created

Container created
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-swf6j

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-srchd

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-srchd

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-srchd

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-srchd

Started

Container started

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-6b575997cc

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-6b575997cc-zthg8

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-srchd

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.027s (3.027s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-srchd

Created

Container created

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-6b575997cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-jcqw2

kuadrant-system

multus

kuadrant-operator-controller-manager-6b575997cc-zthg8

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zthg8

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299"

cert-manager

kubelet

cert-manager-597b95cb84-jcqw2

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-jcqw2

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-jcqw2

Started

Container started

cert-manager

multus

cert-manager-597b95cb84-jcqw2

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zthg8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299" in 6.503s (6.503s including waiting). Image size: 481302115 bytes.

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

multus

kube-auth-proxy-64545848b5-gp7tk

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-64545848b5

SuccessfulCreate

Created pod: kube-auth-proxy-64545848b5-gp7tk

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-gp7tk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-649697ffd5j9s7t

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-649697ffd5 from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-649697ffd5

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-649697ffd5j9s7t

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-64545848b5 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-64545848b5

SuccessfulCreate

Created pod: kube-auth-proxy-64545848b5-ffqsz

openshift-ingress

multus

kube-auth-proxy-64545848b5-ffqsz

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-ffqsz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5j9s7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5j9s7t

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5j9s7t

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-gp7tk

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-gp7tk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.057s (2.057s including waiting). Image size: 188904677 bytes.

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-zthg8_37ccca8a-a3b0-49f4-b8ca-b0b576987e9b

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-6b575997cc-zthg8_37ccca8a-a3b0-49f4-b8ca-b0b576987e9b became leader

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-gp7tk

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-ffqsz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.312s (2.312s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-ffqsz

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-64545848b5-ffqsz

Started

Container started

kuadrant-system

replicaset-controller

mcp-gateway-controller-6c98b995c5

SuccessfulCreate

Created pod: mcp-gateway-controller-6c98b995c5-kczzc

kuadrant-system

deployment-controller

mcp-gateway-controller

ScalingReplicaSet

Scaled up replica set mcp-gateway-controller-6c98b995c5 from 0 to 1

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-57f5c66455 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-57f5c66455

SuccessfulCreate

Created pod: dns-operator-controller-manager-57f5c66455-wqzgt

kuadrant-system

kubelet

authorino-operator-779bff956b-4cdnx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402"

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-wqzgt

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388"

kuadrant-system

multus

mcp-gateway-controller-6c98b995c5-kczzc

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-kczzc

Pulling

Pulling image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa"

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-68669df9c4

SuccessfulCreate

Created pod: limitador-operator-controller-manager-68669df9c4-ktqlt

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-68669df9c4 from 0 to 1

kuadrant-system

multus

dns-operator-controller-manager-57f5c66455-wqzgt

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-779bff956b from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-779bff956b

SuccessfulCreate

Created pod: authorino-operator-779bff956b-4cdnx

kuadrant-system

multus

authorino-operator-779bff956b-4cdnx

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

deployment-controller

developer-portal-controller

ScalingReplicaSet

Scaled up replica set developer-portal-controller-66d8dbb8c8 from 0 to 1

kuadrant-system

multus

limitador-operator-controller-manager-68669df9c4-ktqlt

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-ktqlt

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3"

kuadrant-system

replicaset-controller

developer-portal-controller-66d8dbb8c8

SuccessfulCreate

Created pod: developer-portal-controller-66d8dbb8c8-b2ll6

kuadrant-system

multus

developer-portal-controller-66d8dbb8c8-b2ll6

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-b2ll6

Pulling

Pulling image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-7bbc6bb9d7 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-7bbc6bb9d7

SuccessfulCreate

Created pod: kuadrant-console-plugin-7bbc6bb9d7-92hd8

kuadrant-system

multus

kuadrant-console-plugin-7bbc6bb9d7-92hd8

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-92hd8

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b"

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-b2ll6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90" in 1.825s (1.825s including waiting). Image size: 190254564 bytes.

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-b2ll6

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-ktqlt

Started

Container started

kuadrant-system

developer-portal-controller-66d8dbb8c8-b2ll6_5fd28f33-cc5d-4b82-be10-6b8fa97f8d55

6dd6d79d.kuadrant.io

LeaderElection

developer-portal-controller-66d8dbb8c8-b2ll6_5fd28f33-cc5d-4b82-be10-6b8fa97f8d55 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-ktqlt

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-ktqlt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3" in 2.454s (2.454s including waiting). Image size: 178063410 bytes.

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-b2ll6

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-wqzgt

Started

Container started

kuadrant-system

limitador-operator-controller-manager-68669df9c4-ktqlt_fbf1b410-b8ba-433f-bd4e-9a143aa37eb1

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-68669df9c4-ktqlt_fbf1b410-b8ba-433f-bd4e-9a143aa37eb1 became leader

kuadrant-system

kubelet

authorino-operator-779bff956b-4cdnx

Started

Container started

kuadrant-system

dns-operator-controller-manager-57f5c66455-wqzgt_197e6653-cf2d-4014-a422-0d5df57ce560

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-57f5c66455-wqzgt_197e6653-cf2d-4014-a422-0d5df57ce560 became leader

kuadrant-system

authorino-operator-779bff956b-4cdnx_6908ad42-7269-4d05-b31b-b55d82815d2e

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-779bff956b-4cdnx_6908ad42-7269-4d05-b31b-b55d82815d2e became leader

kuadrant-system

kubelet

authorino-operator-779bff956b-4cdnx

Created

Container created

kuadrant-system

kubelet

authorino-operator-779bff956b-4cdnx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402" in 3.253s (3.253s including waiting). Image size: 167835888 bytes.

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-9cw8s

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-92hd8

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-92hd8

Started

Container started

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-92hd8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b" in 1.218s (1.218s including waiting). Image size: 120696640 bytes.

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-kczzc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa" in 4.036s (4.036s including waiting). Image size: 158458620 bytes.

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-kczzc

Created

Container created

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-kczzc

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-wqzgt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388" in 4.192s (4.192s including waiting). Image size: 192755988 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-wqzgt

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9cw8s

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-9cw8s

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9cw8s

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9cw8s

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-9cw8s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.501s (1.501s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-k7dxv"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-8sggt"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-64db8fcdf6

SuccessfulCreate

Created pod: jobset-controller-manager-64db8fcdf6-qnr64

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-64db8fcdf6 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-77dd99c685 from 0 to 1

openshift-jobset-operator

kubelet

jobset-controller-manager-64db8fcdf6-qnr64

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-64db8fcdf6-qnr64

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulCreate

Created pod: limitador-limitador-77dd99c685-2wwlg

kuadrant-system

multus

limitador-limitador-77dd99c685-2wwlg

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-f7d6b5c7c from 0 to 1

kuadrant-system

kubelet

limitador-limitador-77dd99c685-2wwlg

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

kuadrant-system

replicaset-controller

limitador-limitador-f7d6b5c7c

SuccessfulCreate

Created pod: limitador-limitador-f7d6b5c7c-7sl7d

openshift-jobset-operator

jobset-controller-manager-64db8fcdf6-qnr64_06756386-2d4e-4792-a745-0a2ea5040f1d

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-64db8fcdf6-qnr64_06756386-2d4e-4792-a745-0a2ea5040f1d became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-74ccc46849 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-7sl7d

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

kuadrant-system

kubelet

limitador-limitador-77dd99c685-2wwlg

Started

Container started

kuadrant-system

multus

authorino-74ccc46849-slwk7

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-74ccc46849-slwk7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

limitador-limitador-77dd99c685-2wwlg

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-64db8fcdf6-qnr64

Started

Container started

kuadrant-system

kubelet

limitador-limitador-77dd99c685-2wwlg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 1.32s (1.32s including waiting). Image size: 134933837 bytes.

kuadrant-system

multus

limitador-limitador-f7d6b5c7c-7sl7d

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulCreate

Created pod: authorino-74ccc46849-slwk7

openshift-jobset-operator

kubelet

jobset-controller-manager-64db8fcdf6-qnr64

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-64db8fcdf6-qnr64

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.376s (2.376s including waiting). Image size: 182184678 bytes.

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulCreate

Created pod: authorino-dc8775675-wnqnl

kuadrant-system

multus

authorino-dc8775675-wnqnl

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-dc8775675 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-7sl7d

Created

Container created

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-7sl7d

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 863ms (864ms including waiting). Image size: 134933837 bytes.

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-7sl7d

Started

Container started

kuadrant-system

kubelet

authorino-dc8775675-wnqnl

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

authorino-74ccc46849-slwk7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 1.976s (1.977s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-74ccc46849-slwk7

Started

Container started

kuadrant-system

kubelet

authorino-74ccc46849-slwk7

Created

Container created

kuadrant-system

kubelet

authorino-dc8775675-wnqnl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 2.313s (2.313s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-dc8775675-wnqnl

Started

Container started

kuadrant-system

kubelet

authorino-dc8775675-wnqnl

Created

Container created

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulDelete

Deleted pod: authorino-74ccc46849-slwk7

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-74ccc46849 from 1 to 0

kuadrant-system

kubelet

authorino-74ccc46849-slwk7

Killing

Stopping container authorino

opendatahub

kserve-module-controller-manager-7566cf5fc8-9cw8s_d569c735-2c21-4792-9369-dc70aba3f2a2

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-9cw8s_d569c735-2c21-4792-9369-dc70aba3f2a2 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-77dd99c685 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-77dd99c685-2wwlg

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulDelete

Deleted pod: limitador-limitador-77dd99c685-2wwlg

opendatahub

replicaset-controller

maas-controller-7cb76cfbb6

SuccessfulCreate

Created pod: maas-controller-7cb76cfbb6-fkcm7

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7cb76cfbb6 from 0 to 1

opendatahub

multus

maas-controller-6f6b55dfc4-hv5c5

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7cb76cfbb6-fkcm7

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:2f9be8cdb59c040f32070792fb090a04502f378dd1397b1e214930665237aaad"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6f6b55dfc4 from 0 to 1

opendatahub

replicaset-controller

maas-controller-6f6b55dfc4

SuccessfulCreate

Created pod: maas-controller-6f6b55dfc4-hv5c5

opendatahub

multus

maas-controller-7cb76cfbb6-fkcm7

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6f6b55dfc4-hv5c5

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:2f9be8cdb59c040f32070792fb090a04502f378dd1397b1e214930665237aaad"

opendatahub

kubelet

maas-controller-7cb76cfbb6-fkcm7

Created

Container created

opendatahub

kubelet

maas-controller-7cb76cfbb6-fkcm7

Started

Container started

opendatahub

kubelet

maas-controller-7cb76cfbb6-fkcm7

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:2f9be8cdb59c040f32070792fb090a04502f378dd1397b1e214930665237aaad" in 2.744s (2.744s including waiting). Image size: 200057368 bytes.

opendatahub

kubelet

maas-controller-6f6b55dfc4-hv5c5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:2f9be8cdb59c040f32070792fb090a04502f378dd1397b1e214930665237aaad" in 2.656s (2.656s including waiting). Image size: 200057368 bytes.

opendatahub

kubelet

maas-controller-6f6b55dfc4-hv5c5

Created

Container created

opendatahub

kubelet

maas-controller-6f6b55dfc4-hv5c5

Started

Container started

opendatahub

maas-controller-7cb76cfbb6-fkcm7_c55888ed-f95d-4937-9960-4c8f8f7d736e

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7cb76cfbb6-fkcm7_c55888ed-f95d-4937-9960-4c8f8f7d736e became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-bbmrg

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-r8ft2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-f5cm2

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-r8ft2

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-r8ft2

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-4xfjh

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-bbmrg

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bbmrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bbmrg

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bbmrg

Started

Container started

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-8jrxh

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-xcv5v

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4xfjh

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

kserve-controller-manager-776cc66d47-f5cm2

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

model-serving-api-75bd89fdfc-xcv5v

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-4xfjh

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-f5cm2

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-xcv5v

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpzqc

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-xpzqc

opendatahub

multus

odh-model-controller-769875db56-8jrxh

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-8jrxh

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

model-serving-api-75bd89fdfc-xcv5v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.632s (3.632s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-xcv5v

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-xcv5v

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4xfjh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.287s (4.287s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-f5cm2

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.323s (4.323s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-f5cm2

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-f5cm2

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4xfjh

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4xfjh

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-8jrxh

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-8jrxh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 5.228s (5.228s including waiting). Image size: 236755567 bytes.

opendatahub

odh-model-controller-769875db56-8jrxh_ab355d6f-3498-49a7-b578-e4158772c62d

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-8jrxh_ab355d6f-3498-49a7-b578-e4158772c62d became leader

opendatahub

kubelet

odh-model-controller-769875db56-8jrxh

Started

Container started

opendatahub

llmisvc-controller-manager-869d5dcc5d-4xfjh_fa174e1f-acf2-4570-b744-01f2bf886d81

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-4xfjh_fa174e1f-acf2-4570-b744-01f2bf886d81 became leader

opendatahub

kserve-controller-manager-776cc66d47-f5cm2_0620caf6-b98d-414d-83e5-0351de16346f

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-f5cm2_0620caf6-b98d-414d-83e5-0351de16346f became leader

opendatahub

kubelet

maas-controller-7cb76cfbb6-fkcm7

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7cb76cfbb6 from 1 to 0

opendatahub

replicaset-controller

maas-controller-7cb76cfbb6

SuccessfulDelete

Deleted pod: maas-controller-7cb76cfbb6-fkcm7

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-r8ft2

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-r8ft2

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13s (13s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-r8ft2

Created

Container created

opendatahub

maas-controller-6f6b55dfc4-hv5c5_9780e128-05f6-448f-8aa1-41eaf485e4d9

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6f6b55dfc4-hv5c5_9780e128-05f6-448f-8aa1-41eaf485e4d9 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-7597569d74 from 1 to 0

kuadrant-system

replicaset-controller

authorino-d675dcc65

SuccessfulCreate

Created pod: authorino-d675dcc65-fj2qz

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7597569d74 from 0 to 1

kuadrant-system

replicaset-controller

authorino-65db9f99d7

SuccessfulCreate

Created pod: authorino-65db9f99d7-q88q2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-d675dcc65 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-65db9f99d7 from 1 to 0

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulDelete

Deleted pod: authorino-7597569d74-c9hhs

kuadrant-system

replicaset-controller

authorino-65db9f99d7

SuccessfulDelete

Deleted pod: authorino-65db9f99d7-q88q2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-65db9f99d7 from 0 to 1

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulCreate

Created pod: authorino-7597569d74-c9hhs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Unhealthy

Readiness probe failed: Get "http://10.134.0.25:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

multus

authorino-d675dcc65-fj2qz

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-d675dcc65

SuccessfulDelete

Deleted pod: authorino-d675dcc65-fj2qz

kuadrant-system

kubelet

authorino-d675dcc65-fj2qz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 526ms (526ms including waiting). Image size: 208640811 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

ProbeError

Readiness probe error: Get "http://10.134.0.25:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

kuadrant-system

kubelet

authorino-d675dcc65-fj2qz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-d675dcc65 from 1 to 0

kuadrant-system

replicaset-controller

authorino-8687494d7b

SuccessfulCreate

Created pod: authorino-8687494d7b-rpm8k
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

authorino-d675dcc65-fj2qz

Started

Container started

kuadrant-system

kubelet

authorino-8687494d7b-rpm8k

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 479ms (479ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-8687494d7b-rpm8k

Created

Container created

kuadrant-system

kubelet

authorino-8687494d7b-rpm8k

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Created

Container created

kuadrant-system

kubelet

authorino-d675dcc65-fj2qz

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-d675dcc65-fj2qz

Created

Container created

kuadrant-system

kubelet

authorino-8687494d7b-rpm8k

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

multus

authorino-8687494d7b-rpm8k

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-dc8775675-wnqnl

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulDelete

Deleted pod: authorino-dc8775675-wnqnl
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-q94rt

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q94rt

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-q94rt

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q94rt

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q94rt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 356ms (356ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-q94rt

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-b4jg2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-j6f7m

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-bhd4j

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-bhd4j

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-b4jg2

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-bhd4j

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-bhd4j

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-j6f7m

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-b4jg2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-bhd4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.521s (2.521s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-b4jg2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.679s (2.679s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-b4jg2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-b4jg2

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-bhd4j

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-bhd4j

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-b4jg2

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-b4jg2

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-tz6f5

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 4 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tz6f5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-tz6f5

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tz6f5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tz6f5

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4xfjh

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-4xfjh

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tz6f5

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-x26s8
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tz6f5

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x26s8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-x26s8

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x26s8

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x26s8

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x26s8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.419s (1.419s including waiting). Image size: 183888297 bytes.

opendatahub

ai-gateway-controller-7d85675f98-x26s8_52646d9c-9f69-49c3-879c-a9dc8b2e58b6

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-x26s8_52646d9c-9f69-49c3-879c-a9dc8b2e58b6 became leader
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-trj5g

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-trj5g

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-d4fgq

openshift-ingress

multus

payload-processing-5f78687d5b-d4fgq

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-trj5g

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-d4fgq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-d4fgq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.165s (2.165s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-d4fgq

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-d4fgq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-trj5g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.238s (2.238s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-trj5g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-trj5g

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-q94rt_05712c20-5797-4dbc-8296-861ece175841

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-q94rt_05712c20-5797-4dbc-8296-861ece175841 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-767df45bdd from 0 to 1

opendatahub

multus

ai-gateway-controller-767df45bdd-6djqs

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-767df45bdd

SuccessfulCreate

Created pod: ai-gateway-controller-767df45bdd-6djqs

opendatahub

kubelet

ai-gateway-controller-767df45bdd-6djqs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-767df45bdd-6djqs

Started

Container started

opendatahub

kubelet

ai-gateway-controller-767df45bdd-6djqs

Created

Container created

opendatahub

kubelet

ai-gateway-controller-767df45bdd-6djqs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 416ms (416ms including waiting). Image size: 183888297 bytes.

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-tpxsw

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-zz6dk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-9xmcs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-svcsn

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 5 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tpxsw

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-svcsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-9xmcs

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tpxsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tpxsw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-zz6dk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-zz6dk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-9xmcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-zz6dk

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-svcsn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-9xmcs

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-svcsn

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-svcsn

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-zz6dk

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-tpxsw

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-9xmcs

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x26s8

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-x26s8
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tpxsw

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tpxsw

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-9xmcs

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-svcsn

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-zz6dk

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-zz6dk

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-9xmcs

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-svcsn

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.626s (1.626s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-fqldg

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.129s (1.129s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-xnbks

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 216ms (216ms including waiting). Image size: 98346788 bytes.

opendatahub

ai-gateway-controller-767df45bdd-6djqs_ded2d0da-4775-4ecc-aaa3-ea760f6e6a6a

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-767df45bdd-6djqs_ded2d0da-4775-4ecc-aaa3-ea760f6e6a6a became leader

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 225ms (225ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Started

Container started

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Created

Container created

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 226ms (226ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-zqhtx

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-zqhtx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 208ms (208ms including waiting). Image size: 98346788 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.73s (2.73s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 224ms (225ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 9 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-769df7846c-krsk7

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-krsk7

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

kuadrant-system

replicaset-controller

authorino-8468f79957

SuccessfulCreate

Created pod: authorino-8468f79957-dxp8f

kuadrant-system

multus

authorino-8468f79957-dxp8f

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-8468f79957-dxp8f

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

authorino-8468f79957-dxp8f

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

kuadrant-system

kubelet

authorino-8468f79957-dxp8f

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 838ms (838ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-8468f79957-dxp8f

Created

Container created

kuadrant-system

kubelet

authorino-8687494d7b-rpm8k

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-8687494d7b

SuccessfulDelete

Deleted pod: authorino-8687494d7b-rpm8k
(x4)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-8687494d7b from 1 to 0

openshift-ingress

gateway_labeler_controller

e2e-derive-64505fc5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-64505fc5

openshift-ingress

deployment-controller

e2e-ait-f5bae148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f5bae148-openshift-default-79987cf5cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f5bae148-openshift-default-79987cf5cc

SuccessfulCreate

Created pod: e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

openshift-ingress

gateway_labeler_controller

e2e-ait-f97668b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f97668b9

openshift-ingress

gateway_labeler_controller

e2e-ait-f5bae148

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f5bae148

openshift-ingress

gateway_labeler_controller

e2e-ait-de7186ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-de7186ef

openshift-ingress

replicaset-controller

e2e-derive-64505fc5-openshift-default-75fcf889df

SuccessfulCreate

Created pod: e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

openshift-ingress

deployment-controller

e2e-derive-64505fc5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-64505fc5-openshift-default-75fcf889df from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-de7186ef-openshift-default-7c7d6695d9

SuccessfulCreate

Created pod: e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

openshift-ingress

multus

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85

SuccessfulCreate

Created pod: e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

openshift-ingress

replicaset-controller

e2e-ait-f97668b9-openshift-default-85458b4fff

SuccessfulCreate

Created pod: e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

openshift-ingress

multus

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-f97668b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f97668b9-openshift-default-85458b4fff from 0 to 1

openshift-ingress

deployment-controller

e2e-migrate-8fba532a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-de7186ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-de7186ef-openshift-default-7c7d6695d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-8fba532a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8fba532a-gw

openshift-ingress

multus

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

openshift-ingress

multus

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-e4e24e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-e4e24e

openshift-ingress

deployment-controller

e2e-worker-w0-e4e24e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e4e24e-openshift-default-d477c4d55 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f5bae148-789f65679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f5bae148-789f65679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f5bae148: serviceaccount "payload-processing-e2e-ait-f5bae148" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f5bae148

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f5bae148-789f65679 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f5bae148

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f5bae148-885f5c686 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f5bae148-885f5c686

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f5bae148-885f5c686

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f5bae148-885f5c686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f5bae148: serviceaccount "payload-processing-e2e-ait-f5bae148" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f5bae148-789f65679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-64505fc5-77dc98d8c6

SuccessfulCreate

Created pod: payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-64505fc5-77dc98d8c6

FailedCreate

Error creating: pods "payload-processing-e2e-derive-64505fc5-77dc98d8c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-64505fc5: serviceaccount "payload-processing-e2e-derive-64505fc5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-64505fc5: serviceaccount "payload-processing-e2e-derive-64505fc5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-64505fc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-64505fc5-69fd8b758c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-64505fc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-64505fc5-77dc98d8c6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-de7186ef: serviceaccount "payload-processing-e2e-ait-de7186ef" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-de7186ef-69d5748958

SuccessfulCreate

Created pod: payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-de7186ef-69d5748958

FailedCreate

Error creating: pods "payload-processing-e2e-ait-de7186ef-69d5748958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-de7186ef: serviceaccount "payload-processing-e2e-ait-de7186ef" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-de7186ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-de7186ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-de7186ef-69d5748958 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8fba532a: serviceaccount "payload-processing-e2e-migrate-8fba532a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

openshift-ingress

kubelet

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8fba532a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8fba532a-5d6fd94964 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8fba532a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8fba532a-5d6fd94964

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8fba532a-5d6fd94964-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8fba532a: serviceaccount "payload-processing-e2e-migrate-8fba532a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8fba532a-5d6fd94964

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

openshift-ingress

multus

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-a3c02e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-a3c02e

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

e2e-worker-w1-a3c02e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a3c02e-openshift-default-65c6c99867 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f97668b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f97668b9-c7998ccf5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f97668b9: serviceaccount "payload-processing-e2e-ait-f97668b9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f97668b9-65c448566d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f97668b9-65c448566d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f97668b9: serviceaccount "payload-processing-e2e-ait-f97668b9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f97668b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f97668b9-65c448566d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f97668b9-65c448566d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f97668b9-65c448566d-bkh29

openshift-ingress

kubelet

payload-processing-e2e-ait-f97668b9-65c448566d-bkh29

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.426s (4.426s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-f97668b9-65c448566d-bkh29

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-f97668b9-65c448566d-bkh29

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-f97668b9-65c448566d-bkh29

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.68s (2.68s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e4e24e: serviceaccount "payload-processing-e2e-worker-w0-e4e24e" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.153s (4.153s including waiting). Image size: 125317101 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-e4e24e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.115s (4.115s including waiting). Image size: 125317101 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

openshift-ingress

kubelet

payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.854s (2.854s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-e4e24e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-e4e24e-5cd44579cb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e4e24e: serviceaccount "payload-processing-e2e-worker-w0-e4e24e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-a3c02e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-a3c02e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-a3c02e-6f49487c76 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-a3c02e-6f49487c76

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-a3c02e-6f49487c76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a3c02e: serviceaccount "payload-processing-e2e-worker-w1-a3c02e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-a3c02e-6f49487c76

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a3c02e: serviceaccount "payload-processing-e2e-worker-w1-a3c02e" not found

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f5bae148-789f65679-l6x4l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f5bae148-885f5c686-wfnp6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-64505fc5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f5bae148-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de7186ef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de7186ef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-64505fc5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-8fba532a-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-8fba532a-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f5bae148-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-64505fc5-77dc98d8c6-cwbwx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-64505fc5-69fd8b758c-xkvbz

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-64505fc5-openshift-default-75fcf889df-f5jfc

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w6-a940bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w6-a940bc

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w6-a940bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-a940bc-openshift-default-6d694cb79f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-f97668b9-65c448566d-bkh29

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f97668b9-c7998ccf5-bmsb7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-de7186ef-8ff4b74c9-lg9ct

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w6-a940bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w6-a940bc-7db76d54cb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w6-a940bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779 from 0 to 1

openshift-ingress

kubelet

e2e-ait-f5bae148-openshift-default-79987cf5cc-kcjzm

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w6-a940bc-7db76d54cb

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w6-a940bc-7db76d54cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-a940bc: serviceaccount "payload-processing-e2e-worker-w6-a940bc" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-a940bc: serviceaccount "payload-processing-e2e-worker-w6-a940bc" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w6-a940bc-7db76d54cb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

openshift-ingress

kubelet

payload-processing-e2e-migrate-8fba532a-5d6fd94964-2xn2g

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f97668b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-8fba532a-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de7186ef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8fba532a-d4b467f6c-q8hgx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-de7186ef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f97668b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-8fba532a-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-b31f3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-b31f3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-b31f3f

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-de7186ef-69d5748958-9fnw5

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.56:50052" within 1s: context deadline exceeded
(x5)

openshift-ingress

kubelet

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

Created

Container created

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-a9def7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-a9def7

openshift-ingress

deployment-controller

e2e-worker-w2-a9def7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-a9def7-openshift-default-7fd85dc557 from 0 to 1

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w5-743a5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

openshift-ingress

gateway_labeler_controller

e2e-worker-w5-743a5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-743a5e

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b31f3f: serviceaccount "payload-processing-e2e-worker-w4-b31f3f" not found

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-de7186ef-openshift-default-7c7d6695d9-qm8zv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-b31f3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b31f3f: serviceaccount "payload-processing-e2e-worker-w4-b31f3f" not found

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-b31f3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-b31f3f-6fb8674d76 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

Created

Container created

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-f97668b9-openshift-default-85458b4fff-h6wb5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-8fba532a-gw-openshift-default-5f4f7b5d85-mlpgh

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

openshift-ingress

deployment-controller

e2e-worker-w3-8a9e5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8a9e5f-openshift-default-5c996d895f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-8a9e5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-8a9e5f

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-a9def7-7dd45d5986

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-a9def7: serviceaccount "payload-processing-e2e-worker-w2-a9def7" not found
(x5)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-a9def7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-a9def7-7dd45d5986

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-a9def7-7dd45d5986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-a9def7: serviceaccount "payload-processing-e2e-worker-w2-a9def7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-a9def7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-a9def7-7dd45d5986 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-743a5e-d4b59856b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w5-743a5e-d4b59856b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-743a5e: serviceaccount "payload-processing-e2e-worker-w5-743a5e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w5-743a5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w5-743a5e-8db88755 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-743a5e-8db88755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w5-743a5e-8db88755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-743a5e: serviceaccount "payload-processing-e2e-worker-w5-743a5e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w5-743a5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w5-743a5e-d4b59856b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-743a5e-8db88755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

openshift-ingress

multus

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-743a5e-d4b59856b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-8a9e5f-5979656864

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-8a9e5f-5979656864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-8a9e5f: serviceaccount "payload-processing-e2e-worker-w3-8a9e5f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-8a9e5f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-8a9e5f: serviceaccount "payload-processing-e2e-worker-w3-8a9e5f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-8a9e5f-5979656864

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-8a9e5f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-8a9e5f-5979656864 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e4e24e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e4e24e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-g8rvj

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

e2e-worker-w1-a3c02e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a3c02e-openshift-default-65c6c99867 from 1 to 2
(x2)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

Created

Container created

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc
(x2)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.513s (4.513s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e4e24e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-e4e24e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e4e24e-openshift-default-d477c4d55 from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

openshift-ingress

deployment-controller

e2e-worker-w1-a3c02e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a3c02e-openshift-default-65c6c99867 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

openshift-ingress

deployment-controller

e2e-worker-w4-b31f3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-743a5e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-743a5e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w6-a940bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-a940bc-openshift-default-6d694cb79f from 1 to 2

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e4e24e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-e4e24e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e4e24e-openshift-default-d477c4d55 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

openshift-ingress

deployment-controller

e2e-worker-w2-a9def7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-a9def7-openshift-default-7fd85dc557 from 1 to 2

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

openshift-ingress

deployment-controller

e2e-worker-w3-8a9e5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8a9e5f-openshift-default-5c996d895f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-a3c02e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a3c02e-openshift-default-65c6c99867 from 3 to 4

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-b31f3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

Started

Container started

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

openshift-ingress

deployment-controller

e2e-worker-w0-e4e24e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e4e24e-openshift-default-d477c4d55 from 4 to 5
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e4e24e-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-743a5e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

openshift-ingress

deployment-controller

e2e-worker-w5-743a5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Started

Container started

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

openshift-ingress

deployment-controller

e2e-worker-w6-a940bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-a940bc-openshift-default-6d694cb79f from 2 to 4
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-e4e24e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e4e24e-openshift-default-d477c4d55 from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e4e24e-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

Started

Container started

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

Created

Container created

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-a9def7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-a9def7-openshift-default-7fd85dc557 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-8a9e5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8a9e5f-openshift-default-5c996d895f from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-b31f3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

openshift-ingress

deployment-controller

e2e-worker-w0-e4e24e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e4e24e-openshift-default-d477c4d55 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-e4e24e-openshift-default-d477c4d55

SuccessfulCreate

Created pod: e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e4e24e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes
(x9)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

Started

Container started

openshift-ingress

multus

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Started

Container started

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-743a5e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w5-743a5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-8a9e5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8a9e5f-openshift-default-5c996d895f from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

SuccessfulRescale

New size: 5; reason:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-a3c02e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a3c02e-openshift-default-65c6c99867 from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

Started

Container started

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

openshift-ingress

deployment-controller

e2e-worker-w4-b31f3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w6-a940bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-a940bc-openshift-default-6d694cb79f from 4 to 6
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

openshift-ingress

deployment-controller

e2e-worker-w1-a3c02e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a3c02e-openshift-default-65c6c99867 from 5 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Created

Container created

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Started

Container started

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

openshift-ingress

deployment-controller

e2e-worker-w6-a940bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-a940bc-openshift-default-6d694cb79f from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w6-a940bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-a940bc-openshift-default-6d694cb79f from 8 to 10

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-a940bc-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

openshift-ingress

replicaset-controller

e2e-worker-w6-a940bc-openshift-default-6d694cb79f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

Started

Container started

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-8a9e5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8a9e5f-openshift-default-5c996d895f from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

openshift-ingress

replicaset-controller

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f

SuccessfulCreate

Created pod: e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8a9e5f-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-b31f3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-b31f3f-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

openshift-ingress

replicaset-controller

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff

SuccessfulCreate

Created pod: e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

openshift-ingress

deployment-controller

e2e-worker-w2-a9def7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-a9def7-openshift-default-7fd85dc557 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w5-743a5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5 from 4 to 7

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-743a5e-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Started

Container started

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Started

Container started

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

openshift-ingress

replicaset-controller

e2e-worker-w2-a9def7-openshift-default-7fd85dc557

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-a9def7-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-a9def7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-a9def7-openshift-default-7fd85dc557 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Unhealthy

Liveness probe failed: Get "https://10.134.0.49:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a3c02e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-a3c02e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a3c02e-openshift-default-65c6c99867 from 7 to 10

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

openshift-ingress

replicaset-controller

e2e-worker-w1-a3c02e-openshift-default-65c6c99867

SuccessfulCreate

Created pod: e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w5-743a5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-743a5e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

openshift-ingress

replicaset-controller

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5

SuccessfulCreate

Created pod: e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Started

Container started

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-zz6dk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-zz6dk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tz6f5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-tz6f5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-bhd4j

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-bhd4j

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-751a7416

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-751a7416

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

openshift-ingress

deployment-controller

e2e-mt-751a7416-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-751a7416-openshift-default-7cf959db5 from 0 to 1

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-751a7416

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-751a7416-8f4b79588 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-751a7416

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-751a7416-9bcfd9775 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-751a7416-8f4b79588

SuccessfulCreate

Created pod: payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-751a7416-8f4b79588

FailedCreate

Error creating: pods "payload-processing-e2e-mt-751a7416-8f4b79588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-751a7416: serviceaccount "payload-processing-e2e-mt-751a7416" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-751a7416-9bcfd9775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-751a7416-9bcfd9775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-751a7416: serviceaccount "payload-processing-e2e-mt-751a7416" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-751a7416-9bcfd9775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz

openshift-ingress

multus

payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-a9f9aa-openshift-default-7fd8548c55

SuccessfulCreate

Created pod: e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg

openshift-ingress

gateway_labeler_controller

e2e-api-a-a9f9aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a9f9aa

openshift-ingress

deployment-controller

e2e-api-a-a9f9aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a9f9aa-openshift-default-7fd8548c55 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg

Started

Container started

openshift-ingress

kubelet

e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg

Created

Container created

openshift-ingress

kubelet

e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a9f9aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a9f9aa-6697b44f6d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a9f9aa-6697b44f6d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a9f9aa-6697b44f6d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a9f9aa-6697b44f6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a9f9aa: serviceaccount "payload-processing-e2e-api-a-a9f9aa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a9f9aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a9f9aa: serviceaccount "payload-processing-e2e-api-a-a9f9aa" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-zlz8n

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 6.084s (6.084s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a9f9aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a9f9aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

Created

Container created

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

Created

Container created

openshift-ingress

deployment-controller

e2e-mt-751a7416-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-751a7416-openshift-default-7cf959db5 from 1 to 4

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

Created

Container created

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-6df539

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6df539

openshift-ingress

deployment-controller

e2e-api-b-6df539-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6df539-openshift-default-d87cc874f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-6df539-openshift-default-d87cc874f

SuccessfulCreate

Created pod: e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

openshift-ingress

multus

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6df539

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6df539-748f99ddcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6df539-748f99ddcd

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6df539-748f99ddcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6df539: serviceaccount "payload-processing-e2e-api-b-6df539" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6df539-748f99ddcd

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6df539

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6df539-5576568c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6df539-5576568c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6df539-5576568c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6df539-5576568c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6df539: serviceaccount "payload-processing-e2e-api-b-6df539" not found

openshift-ingress

multus

payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tpxsw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 7 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-tpxsw

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-mt-751a7416-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-751a7416-openshift-default-7cf959db5 from 4 to 5

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

Created

Container created

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-734480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-734480-openshift-default-7cc69fc667 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-734480-openshift-default-7cc69fc667

SuccessfulCreate

Created pod: e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-734480

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-734480

openshift-ingress

multus

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-734480-b8c46d65b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-734480-b8c46d65b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-734480: serviceaccount "payload-processing-e2e-ipp-a-734480" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-734480

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-734480-6785f64979 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-734480-6785f64979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-734480-6785f64979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-734480-6785f64979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-734480: serviceaccount "payload-processing-e2e-ipp-a-734480" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-734480

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-734480-b8c46d65b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-734480-b8c46d65b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-a9f9aa-6697b44f6d-p69w7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a9f9aa-7479bf578c-wzvzt

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x33)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Unhealthy

Readiness probe failed: Get "https://10.134.0.49:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-a-f6171d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f6171d

openshift-ingress

replicaset-controller

e2e-api-a-f6171d-openshift-default-64847464f9

SuccessfulCreate

Created pod: e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

openshift-ingress

deployment-controller

e2e-api-a-f6171d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f6171d-openshift-default-64847464f9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Unhealthy

Readiness probe failed: Get "http://10.134.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

ProbeError

Readiness probe error: Get "http://10.134.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Unhealthy

Readiness probe failed: Get "http://10.134.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Unhealthy

Readiness probe failed: Get "http://10.134.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

ProbeError

Readiness probe error: Get "http://10.134.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

ProbeError

Readiness probe error: Get "http://10.134.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

Created

Container created

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

Started

Container started

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-mt-751a7416-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-751a7416-openshift-default-7cf959db5 from 5 to 7

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f6171d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-a-380eea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-380eea

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f6171d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-380eea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-380eea-openshift-default-b4d48cf57 from 0 to 1

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

Created

Container created

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

Started

Container started

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

Created

Container created

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f6171d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f6171d-d6588cdfb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f6171d: serviceaccount "payload-processing-e2e-api-a-f6171d" not found

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f6171d-d6588cdfb

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f6171d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f6171d-58b4df49f9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f6171d-d6588cdfb

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f6171d-d6588cdfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f6171d: serviceaccount "payload-processing-e2e-api-a-f6171d" not found

openshift-ingress

multus

payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-380eea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-380eea-79d98c865d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-380eea: serviceaccount "payload-processing-e2e-api-a-380eea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-380eea-79d98c865d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-380eea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-380eea-559cdd6f7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-380eea-79d98c865d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-380eea-79d98c865d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-380eea: serviceaccount "payload-processing-e2e-api-a-380eea" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-b8c46d65b-xc2x5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-6785f64979-f2fcc

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f6171d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f6171d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-f556s

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-f556s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-a9f9aa-openshift-default-7fd8548c55-6c7lg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

openshift-ingress

deployment-controller

e2e-ipp-a-dd38c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dd38c2-openshift-default-c8698fc87 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-dd38c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-dd38c2

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-380eea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-380eea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dd38c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd38c2-b866b75b8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd38c2: serviceaccount "payload-processing-e2e-ipp-a-dd38c2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd38c2-b866b75b8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dd38c2-b866b75b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd38c2: serviceaccount "payload-processing-e2e-ipp-a-dd38c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dd38c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dd38c2-b866b75b8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6df539-5576568c-w67tx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6df539-748f99ddcd-cckfz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-734480

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-734480-66479fd5db from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-734480

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-734480-8477f98fc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-734480-66479fd5db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-734480-66479fd5db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-734480-66479fd5db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-734480: serviceaccount "payload-processing-e2e-ipp-a-734480" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-734480: serviceaccount "payload-processing-e2e-ipp-a-734480" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.956s (1.956s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.069s (2.069s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-a26f29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a26f29

openshift-ingress

deployment-controller

e2e-api-b-a26f29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a26f29-openshift-default-f5d6bf475 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-a26f29-openshift-default-f5d6bf475

SuccessfulCreate

Created pod: e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

openshift-ingress

kubelet

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

Started

Container started

openshift-ingress

multus

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

Created

Container created

openshift-ingress

kubelet

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a26f29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a26f29-5f5cb9764 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a26f29-6d695f674c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a26f29-6d695f674c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a26f29: serviceaccount "payload-processing-e2e-api-b-a26f29" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a26f29-5f5cb9764

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a26f29-5f5cb9764

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a26f29-5f5cb9764-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a26f29: serviceaccount "payload-processing-e2e-api-b-a26f29" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a26f29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a26f29-6d695f674c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-301fcc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-301fcc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd38c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a26f29-6d695f674c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd38c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-301fcc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-301fcc-openshift-default-767d445955 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2d53cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2d53cd

openshift-ingress

replicaset-controller

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c

SuccessfulCreate

Created pod: e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

openshift-ingress

deployment-controller

e2e-ipp-b-2d53cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-301fcc-openshift-default-767d445955

SuccessfulCreate

Created pod: e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6df539-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.528s (3.528s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.856s (3.856s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6df539-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d53cd: serviceaccount "payload-processing-e2e-ipp-b-2d53cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d53cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d53cd: serviceaccount "payload-processing-e2e-ipp-b-2d53cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d53cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-301fcc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-301fcc-67f67c7d44 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-301fcc: serviceaccount "payload-processing-e2e-api-b-301fcc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-301fcc-67f67c7d44

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-301fcc-67f67c7d44

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-301fcc-67f67c7d44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-301fcc: serviceaccount "payload-processing-e2e-api-b-301fcc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-301fcc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-301fcc-56cb7559b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-wrfmq

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6df539-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6df539-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a26f29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a26f29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-6df539-openshift-default-d87cc874f-h6v5k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f363a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f363a3

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

openshift-ingress

deployment-controller

e2e-ipp-a-f363a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f363a3-openshift-default-66498c7fb7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-66d786fb59-jz84z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-b866b75b8-gl4m9

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f363a3-766799c548

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f363a3-766799c548-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f363a3: serviceaccount "payload-processing-e2e-ipp-a-f363a3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f363a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f363a3-766799c548 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f363a3: serviceaccount "payload-processing-e2e-ipp-a-f363a3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f363a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f363a3-766799c548

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-751a7416-9bcfd9775-q9wfz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-751a7416-8f4b79588-pdlnr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dd38c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dd38c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd38c2: serviceaccount "payload-processing-e2e-ipp-a-dd38c2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd38c2: serviceaccount "payload-processing-e2e-ipp-a-dd38c2" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-edc2d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-edc2d3

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

openshift-ingress

deployment-controller

e2e-ipp-a-edc2d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-edc2d3-openshift-default-7c9467cc57 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-7847cd8f7b-5f5qs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-df42c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-df42c7

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

openshift-ingress

deployment-controller

e2e-ipp-b-df42c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-df42c7-openshift-default-6bc46b48f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-f6171d-d6588cdfb-9pcbw

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.116:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f6171d-58b4df49f9-7r69c

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.115:50052" within 1s: context deadline exceeded

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Unhealthy

Readiness probe failed: Get "https://10.132.0.43:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-c7f6655f5-8bvbj

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.122:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-edc2d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-edc2d3-5cc66df658

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-edc2d3: serviceaccount "payload-processing-e2e-ipp-a-edc2d3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-edc2d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-edc2d3-5cc66df658 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-edc2d3-5cc66df658

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-edc2d3-5cc66df658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-edc2d3: serviceaccount "payload-processing-e2e-ipp-a-edc2d3" not found

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

ProbeError

Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

Unhealthy

Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-df42c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df42c7-d98767f94

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-df42c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-df42c7-d98767f94 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df42c7-d98767f94

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-df42c7-d98767f94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df42c7: serviceaccount "payload-processing-e2e-ipp-b-df42c7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df42c7: serviceaccount "payload-processing-e2e-ipp-b-df42c7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9

Created

Container created

openshift-ingress

deployment-controller

e2e-mt-751a7416-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-751a7416-openshift-default-7cf959db5 from 7 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-751a7416-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-751a7416-openshift-default-7cf959db5

SuccessfulCreate

Created pod: e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

Started

Container started

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-380eea-79d98c865d-9tqd9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-380eea-559cdd6f7f-pmhz4

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df42c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df42c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-380eea-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

openshift-ingress

deployment-controller

e2e-api-a-380eea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-380eea-openshift-default-b4d48cf57 from 1 to 4

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

Started

Container started

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

Created

Container created

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

Created

Container created

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

Started

Container started

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

Started

Container started

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d53cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d53cd: serviceaccount "payload-processing-e2e-ipp-b-2d53cd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d53cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d53cd-5d999bd97d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d53cd: serviceaccount "payload-processing-e2e-ipp-b-2d53cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-766799c548-bxdc9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-66bd7467f9-mxf22

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-dd38c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dd38c2-openshift-default-c8698fc87 from 1 to 4

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd38c2-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

Started

Container started

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

Started

Container started

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-380eea-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

openshift-ingress

deployment-controller

e2e-api-a-380eea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-380eea-openshift-default-b4d48cf57 from 4 to 8

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

openshift-ingress

replicaset-controller

e2e-api-a-380eea-openshift-default-b4d48cf57

SuccessfulCreate

Created pod: e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

ProbeError

Readiness probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

Unhealthy

Readiness probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

Started

Container started

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

Created

Container created

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

Started

Container started

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

Created

Container created

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

Started

Container started

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

ProbeError

Readiness probe error: Get "http://10.134.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

Unhealthy

Readiness probe failed: Get "http://10.134.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

ProbeError

Startup probe error: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

Unhealthy

Startup probe failed: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd38c2-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-dd38c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dd38c2-openshift-default-c8698fc87 from 4 to 8

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

Created

Container created

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d53cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d53cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Unhealthy

Readiness probe failed: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-a-f6171d-openshift-default-64847464f9

SuccessfulCreate

Created pod: e2e-api-a-f6171d-openshift-default-64847464f9-pxmhg
(x11)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

ProbeError

Readiness probe error: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f6171d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-a-f6171d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f6171d-openshift-default-64847464f9 from 1 to 2
(x11)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tmcw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-sqzlf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-xcpv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-dkstw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-tp8mc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-9ae129-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9ae129-openshift-default-65fc746555 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-9ae129

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9ae129

openshift-ingress

replicaset-controller

e2e-api-a-9ae129-openshift-default-65fc746555

SuccessfulCreate

Created pod: e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f363a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f363a3-747b47546 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f363a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f363a3-747b47546

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f363a3-747b47546

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f363a3-747b47546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f363a3: serviceaccount "payload-processing-e2e-ipp-a-f363a3" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f363a3: serviceaccount "payload-processing-e2e-ipp-a-f363a3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-a26f29-5f5cb9764-4r6zq

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a26f29-6d695f674c-mncsp

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.337s (1.337s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.057s (2.057s including waiting). Image size: 166612641 bytes.
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9ae129-b8dc59c64

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9ae129-b8dc59c64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9ae129: serviceaccount "payload-processing-e2e-api-a-9ae129" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-380eea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d53cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d53cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9ae129: serviceaccount "payload-processing-e2e-api-a-9ae129" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9ae129

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9ae129-d5cbb7647 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-380eea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd38c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd38c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9ae129

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9ae129-b8dc59c64 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9ae129-b8dc59c64

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5fb66bfbcf-tgh5n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-5cc66df658-x7847

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

ProbeError

Readiness probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Unhealthy

Liveness probe failed: Get "https://10.134.0.48:8000/health": context deadline exceeded

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

ProbeError

Readiness probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-pntbr

Unhealthy

Readiness probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-2vdtq

Unhealthy

Readiness probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Unhealthy

Readiness probe failed: Get "http://10.134.0.29:8081/readyz": dial tcp 10.134.0.29:8081: connect: connection refused

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Unhealthy

Liveness probe failed: Get "http://10.134.0.29:8081/healthz": dial tcp 10.134.0.29:8081: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.60:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

ProbeError

Readiness probe error: Get "http://10.134.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.156:50052" within 1s: context deadline exceeded

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zthg8

Unhealthy

Liveness probe failed: Get "http://10.134.0.33:8081/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.61:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

Unhealthy

Readiness probe failed: Get "http://10.134.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.74:50052" within 1s: context deadline exceeded

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Unhealthy

Liveness probe failed: Get "https://10.134.0.47:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

Unhealthy

Readiness probe failed: timeout: health rpc did not complete within 1s

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

Unhealthy

Readiness probe failed: timeout: health rpc did not complete within 1s

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

Unhealthy

Readiness probe failed: timeout: health rpc did not complete within 1s

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Unhealthy

Readiness probe failed: timeout: health rpc did not complete within 1s
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zthg8

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:8081/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-d98767f94-29cmn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-84466d8cd7-j29r9

Killing

Stopping container payload-pre-processing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zthg8

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

ComponentUnhealthy

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

AllRequirementsMet

all requirements found, attempting install
(x2)

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

ProbeError

Readiness probe error: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-f6171d-openshift-default-64847464f9-s44m2

Unhealthy

Readiness probe failed: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

ProbeError

Readiness probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-751a7416-openshift-default-7cf959db5-4trvs

Unhealthy

Readiness probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-a9e67f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a9e67f-openshift-default-f9595bbb9 from 0 to 1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zthg8

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9

SuccessfulCreate

Created pod: e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn
(x2)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-zthg8

Started

Container started

opendatahub-operator-system

opendatahub-operator-controller-manager-59b57f6f78-2lkkd_2bb08cc6-eb6d-47e1-a7cb-bef2eabe171e

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-59b57f6f78-2lkkd_2bb08cc6-eb6d-47e1-a7cb-bef2eabe171e became leader

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a9e67f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a9e67f

opendatahub

kubelet

odh-model-controller-769875db56-8jrxh

Killing

Stopping container manager

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.339s (3.339s including waiting). Image size: 273709574 bytes.

openshift-ingress

multus

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x5)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Started

Container started
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-59b57f6f78-t48hs

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-dd38c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dd38c2-openshift-default-c8698fc87 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd38c2-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

(combined from similar events): Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

openshift-ingress

replicaset-controller

e2e-ipp-a-dd38c2-openshift-default-c8698fc87

SuccessfulCreate

Created pod: e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-dq4xb

opendatahub

kubelet

odh-model-controller-769875db56-dq4xb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 411ms (411ms including waiting). Image size: 236755567 bytes.

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

Created

Container created

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-dq4xb

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-dq4xb

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

odh-model-controller-769875db56-dq4xb

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-dq4xb

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9e67f: serviceaccount "payload-processing-e2e-ipp-b-a9e67f" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a9e67f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a9e67f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9e67f: serviceaccount "payload-processing-e2e-ipp-b-a9e67f" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

Started

Container started

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-c8n25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7gq55

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-vn95k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-74lvz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-7sqb4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-52rtg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-rzqzq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-380eea-openshift-default-b4d48cf57-wdqjk

Killing

Stopping container istio-proxy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

install strategy completed with no errors
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors
(x12)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Error

Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-734480-8477f98fc9-9wrn4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-734480-66479fd5db-ct8c4

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f363a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df42c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f363a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-zthg8_a5f3ca86-fb54-4123-920e-cbb0aad65892

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-6b575997cc-zthg8_a5f3ca86-fb54-4123-920e-cbb0aad65892 became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df42c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-734480-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a26f29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-734480-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a26f29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-301fcc-56cb7559b7-zpqlw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-301fcc-67f67c7d44-fbvfk

Killing

Stopping container payload-processing

opendatahub

odh-model-controller-769875db56-dq4xb_796224c3-bfe9-45d3-88ea-3ddad289b112

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-dq4xb_796224c3-bfe9-45d3-88ea-3ddad289b112 became leader
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-edc2d3: serviceaccount "payload-processing-e2e-ipp-a-edc2d3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-edc2d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-edc2d3-869f9df58d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-edc2d3-869f9df58d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-edc2d3-869f9df58d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-edc2d3-869f9df58d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-edc2d3: serviceaccount "payload-processing-e2e-ipp-a-edc2d3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-edc2d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df42c7: serviceaccount "payload-processing-e2e-ipp-b-df42c7" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df42c7-79d869c684

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-df42c7-79d869c684-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df42c7: serviceaccount "payload-processing-e2e-ipp-b-df42c7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-df42c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-df42c7-79d869c684 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-df42c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df42c7-79d869c684

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

ProbeError

Readiness probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-734480-openshift-default-7cc69fc667-flfk8

Unhealthy

Readiness probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

Started

Container started

openshift-ingress

kubelet

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449

SuccessfulCreate

Created pod: e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

openshift-ingress

deployment-controller

e2e-ipp-a-b80d5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b80d5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b80d5b

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f82846

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f82846

openshift-ingress

replicaset-controller

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65

SuccessfulCreate

Created pod: e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

openshift-ingress

deployment-controller

e2e-ipp-b-f82846-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f82846-openshift-default-5cb5cd7b65 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d53cd-5d999bd97d-lk2qn

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-301fcc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d53cd-5876c5456c-m8mds

Unhealthy

Readiness probe failed: dial tcp 10.134.0.166:9004: i/o timeout

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-301fcc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x30)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Unhealthy

Readiness probe failed: Get "https://10.134.0.49:8000/ready": context deadline exceeded
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f82846-66b974f8c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f82846-66b974f8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f82846: serviceaccount "payload-processing-e2e-ipp-b-f82846" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f82846

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f82846-54b554d55f from 0 to 1

openshift-ingress

deployment-controller

e2e-api-b-48c52b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-48c52b-openshift-default-6d88cd8ddc from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f82846: serviceaccount "payload-processing-e2e-ipp-b-f82846" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f82846

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f82846-66b974f8c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-48c52b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-48c52b

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f82846-66b974f8c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch
(x3)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b80d5b-86b5d744db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b80d5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b80d5b-86b5d744db from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b80d5b-86b5d744db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b80d5b-86b5d744db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b80d5b: serviceaccount "payload-processing-e2e-ipp-a-b80d5b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b80d5b: serviceaccount "payload-processing-e2e-ipp-a-b80d5b" not found
(x3)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b80d5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9 from 0 to 1
(x3)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Unhealthy

Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-praxis-a-27cda7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-27cda7-openshift-default-86df67d6bf from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-2d53cd-openshift-default-77fdb9d4c-6b62w

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-27cda7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-27cda7

openshift-ingress

replicaset-controller

e2e-praxis-a-27cda7-openshift-default-86df67d6bf

SuccessfulCreate

Created pod: e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5
(x2)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

ProbeError

Readiness probe error: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Unhealthy

Readiness probe failed: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

ProbeError

Readiness probe error: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Unhealthy

Readiness probe failed: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Unhealthy

Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

Created

Container created

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch

Created

Container created
(x4)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

Unhealthy

Readiness probe failed: Get "http://10.134.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

ProbeError

Readiness probe error: Get "http://10.134.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

ProbeError

Readiness probe error: Get "http://10.132.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Unhealthy

Readiness probe failed: Get "http://10.132.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

Unhealthy

Readiness probe failed: Get "http://10.134.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Unhealthy

Readiness probe failed: Get "https://10.134.0.45:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-a26f29-openshift-default-f5d6bf475-2k2cj

ProbeError

Readiness probe error: Get "http://10.134.0.154:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng

Created

Container created

openshift-ingress

multus

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-48c52b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-48c52b-6f648586cf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-48c52b-6b84fd4d5b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-48c52b-6b84fd4d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-48c52b: serviceaccount "payload-processing-e2e-api-b-48c52b" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-48c52b-6b84fd4d5b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-48c52b-6f648586cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-48c52b-6f648586cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-48c52b: serviceaccount "payload-processing-e2e-api-b-48c52b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-48c52b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-48c52b-6b84fd4d5b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-48c52b-6f648586cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

openshift-ingress

multus

payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df42c7-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

openshift-ingress

kubelet

payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-ipp-b-df42c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-df42c7-openshift-default-6bc46b48f from 1 to 3
(x12)

openshift-ingress

kubelet

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-301fcc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd38c2-7bb7c8d8b6-rcrxs

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-a-edc2d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-edc2d3-openshift-default-7c9467cc57 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-301fcc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd38c2-56f5648bb7-hmlwd

Unhealthy

Readiness probe failed: dial tcp 10.134.0.160:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x13)

openshift-ingress

kubelet

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-27cda7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-27cda7-5c5854cd64 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-27cda7-5c5854cd64

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-27cda7-5c5854cd64

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-27cda7-5c5854cd64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-27cda7: serviceaccount "payload-processing-e2e-praxis-a-27cda7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-27cda7: serviceaccount "payload-processing-e2e-praxis-a-27cda7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-27cda7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-69b9c86ccd-z9wm9

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-6rdqq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h924b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-tc6cn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-hk8t8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-869b689d6c-kz99b

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.146:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ppfkb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-pc65d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ntgtt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

Killing

Stopping container istio-proxy
(x10)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

Unhealthy

Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

ProbeError

Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

openshift-ingress

deployment-controller

e2e-ipp-b-df42c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-df42c7-openshift-default-6bc46b48f from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df42c7-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-h72vf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-nxfmg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-edc2d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-edc2d3-openshift-default-7c9467cc57 from 2 to 4

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

Created

Container created

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

Created

Container created

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

Started

Container started

openshift-ingress

kubelet

e2e-api-b-301fcc-openshift-default-767d445955-5mlgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x12)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

Unhealthy

Startup probe failed: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d

openshift-ingress

replicaset-controller

e2e-ipp-b-df42c7-openshift-default-6bc46b48f

SuccessfulCreate

Created pod: e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f363a3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-df42c7-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-ipp-b-df42c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-df42c7-openshift-default-6bc46b48f from 6 to 8

openshift-ingress

deployment-controller

e2e-ipp-a-f363a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f363a3-openshift-default-66498c7fb7 from 1 to 4
(x5)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb
(x13)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

Unhealthy

Readiness probe failed: Get "http://10.134.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

SuccessfulRescale

New size: 8; reason:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x13)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs
(x12)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z
(x13)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

ProbeError

Startup probe error: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

ProbeError

Readiness probe error: Get "http://10.134.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Unhealthy

Readiness probe failed: Get "https://10.134.0.47:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-ipp-a-edc2d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-edc2d3-openshift-default-7c9467cc57 from 4 to 8

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Unhealthy

Liveness probe failed: Get "https://10.132.0.42:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

Unhealthy

Readiness probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

ProbeError

Readiness probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df42c7-7654dd46dc-8s8xf

Unhealthy

Readiness probe failed: dial tcp 10.134.0.177:9004: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-48c52b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-48c52b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Unhealthy

Readiness probe failed: timeout: health rpc did not complete within 1s

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

Started

Container started
(x3)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

ProbeError

Readiness probe error: Get "http://10.134.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Unhealthy

Readiness probe failed: Get "https://10.134.0.48:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df42c7-79d869c684-6w82z

Unhealthy

Readiness probe failed: dial tcp 10.134.0.178:9004: i/o timeout
(x3)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

Unhealthy

Readiness probe failed: Get "http://10.134.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Unhealthy

Liveness probe failed: Get "https://10.134.0.46:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

ProbeError

Readiness probe error: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-ipp-a-dd38c2-openshift-default-c8698fc87-ls4mv

Unhealthy

Readiness probe failed: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-27cda7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-58v2d

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-27cda7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-glcdb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

Created

Container created
(x2)

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Unhealthy

Readiness probe failed: Get "https://10.134.0.45:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

Started

Container started

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-d2mpt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

Created

Container created

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-8lcvb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-n66pg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-ggkgn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-sgfzs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-df42c7-openshift-default-6bc46b48f-2949d

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

ProbeError

Readiness probe error: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Unhealthy

Readiness probe failed: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f363a3-openshift-default

SuccessfulRescale

New size: 6; reason:

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a9e67f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9e67f: serviceaccount "payload-processing-e2e-ipp-b-a9e67f" not found

openshift-ingress

deployment-controller

e2e-ipp-a-f363a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f363a3-openshift-default-66498c7fb7 from 4 to 6

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a9e67f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a9e67f: serviceaccount "payload-processing-e2e-ipp-b-a9e67f" not found

openshift-ingress

deployment-controller

e2e-ipp-a-edc2d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-edc2d3-openshift-default-7c9467cc57 from 8 to 10

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57

SuccessfulCreate

(combined from similar events): Created pod: e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9ae129-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x9)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x2)

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Unhealthy

Readiness probe failed: Get "https://10.132.0.42:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9ae129-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x8)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

Created

Container created

openshift-ingress

multus

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

Unhealthy

Startup probe failed: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

ProbeError

Startup probe error: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-a9e67f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a9e67f-openshift-default-f9595bbb9 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9e67f-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9

SuccessfulCreate

Created pod: e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9

SuccessfulCreate

Created pod: e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

openshift-ingress

replicaset-controller

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9

SuccessfulCreate

Created pod: e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

Created

Container created

openshift-ingress

multus

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

Unhealthy

Startup probe failed: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

ProbeError

Startup probe error: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-edc2d3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-66b974f8c4-8x9ch

Killing

Stopping container payload-processing
(x9)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

Unhealthy

Startup probe failed: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

ProbeError

Startup probe error: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

ProbeError

Readiness probe error: Get "http://10.134.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

Unhealthy

Readiness probe failed: Get "http://10.134.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-86b5d744db-8gkng

Killing

Stopping container payload-processing
(x10)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-dfffc75c9-nmfd5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x8)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

ProbeError

Startup probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

Unhealthy

Startup probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-a9def7-6b4c4f4f6c-tct9z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-54b554d55f-hwzgg

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.151:50052" within 1s: context deadline exceeded
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

ProbeError

Readiness probe error: Get "http://10.134.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

Unhealthy

Readiness probe failed: Get "http://10.134.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9e67f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9e67f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f363a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f363a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

Unhealthy

Startup probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

ProbeError

Startup probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-a9def7-7dd45d5986-vb64x

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.72:50052" within 1s: context deadline exceeded
(x7)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

Unhealthy

Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

ProbeError

Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a3c02e-5748cb5747-4dq8q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-praxis-b-4e8583-openshift-default-674465474f

SuccessfulCreate

Created pod: e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

openshift-ingress

deployment-controller

e2e-praxis-b-4e8583-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-4e8583-openshift-default-674465474f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-4e8583

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-4e8583
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a3c02e-6f49487c76-htrsb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f82846

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f82846-776b6998c6 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9e67f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9e67f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f82846-776b6998c6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f82846-776b6998c6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f82846-776b6998c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f82846: serviceaccount "payload-processing-e2e-ipp-b-f82846" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f82846

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f82846-f95f6956c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f82846: serviceaccount "payload-processing-e2e-ipp-b-f82846" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ae129-b8dc59c64-gtpj4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ae129-d5cbb7647-qnnmf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4e8583-898d6767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4e8583-d95bddb4d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-4e8583

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-4e8583-898d6767 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4e8583-d95bddb4d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-4e8583-d95bddb4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4e8583: serviceaccount "payload-processing-e2e-praxis-b-4e8583" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4e8583-898d6767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-4e8583-898d6767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4e8583: serviceaccount "payload-processing-e2e-praxis-b-4e8583" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-4e8583

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-4e8583-d95bddb4d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b80d5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b80d5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b80d5b-69f7db55b4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b80d5b: serviceaccount "payload-processing-e2e-ipp-a-b80d5b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b80d5b: serviceaccount "payload-processing-e2e-ipp-a-b80d5b" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5

Started

Container started

openshift-ingress

multus

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-a9e67f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a9e67f-openshift-default-f9595bbb9 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a9e67f-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9

SuccessfulCreate

Created pod: e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

openshift-ingress

multus

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9

SuccessfulCreate

Created pod: e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f363a3-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-f363a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f363a3-openshift-default-66498c7fb7 from 6 to 10

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

(combined from similar events): Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

openshift-ingress

replicaset-controller

e2e-ipp-a-f363a3-openshift-default-66498c7fb7

SuccessfulCreate

Created pod: e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Unhealthy

Readiness probe failed: Get "https://10.134.0.48:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Unhealthy

Readiness probe failed: Get "https://10.134.0.48:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-85qf7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-8n89f

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-75db5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-75db5b

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-slv2m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-75db5b-openshift-default-84786bddf5

SuccessfulCreate

Created pod: e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

openshift-ingress

deployment-controller

e2e-ipp-b-75db5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-75db5b-openshift-default-84786bddf5 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-pt68f

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Killing

Stopping container istio-proxy
(x11)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes
(x11)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Unhealthy

Readiness probe failed: Get "https://10.132.0.42:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Unhealthy

Readiness probe failed: Get "https://10.134.0.45:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Unhealthy

Readiness probe failed: Get "https://10.134.0.47:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

Unhealthy

Readiness probe failed: Get "http://10.134.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

ProbeError

Readiness probe error: Get "http://10.134.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

ProbeError

Readiness probe error: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Unhealthy

Readiness probe failed: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Unhealthy

Readiness probe failed: Get "https://10.132.0.41:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

ProbeError

Readiness probe error: Get "http://10.134.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Unhealthy

Readiness probe failed: Get "http://10.134.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

ProbeError

Readiness probe error: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Created

Container created
(x12)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

Unhealthy

Readiness probe failed: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x12)

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Created

Container created

openshift-ingress

multus

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

Unhealthy

Readiness probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

ProbeError

Readiness probe error: Get "http://10.134.0.98:15021/healthz/ready": read tcp 10.134.0.2:46258->10.134.0.98:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

Unhealthy

Readiness probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-l56ns

ProbeError

Readiness probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-cwfbm

Unhealthy

Readiness probe failed: Get "http://10.134.0.98:15021/healthz/ready": read tcp 10.134.0.2:46258->10.134.0.98:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-ghl42

ProbeError

Readiness probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-d7xnc

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Started

Container started
(x4)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

Unhealthy

Readiness probe failed: Get "http://10.134.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-vzwvt

Unhealthy

Readiness probe failed: Get "https://10.134.0.45:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-xjrf6

ProbeError

Readiness probe error: Get "http://10.134.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-zqhtx

Unhealthy

Readiness probe failed: Get "https://10.134.0.47:8000/ready": context deadline exceeded
(x4)

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-a3c02e-openshift-default-65c6c99867-g85lc

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-75db5b: serviceaccount "payload-processing-e2e-ipp-b-75db5b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-75db5b-696cb4656d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-75db5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-75db5b-696cb4656d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-75db5b-696cb4656d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-75db5b-696cb4656d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-75db5b: serviceaccount "payload-processing-e2e-ipp-b-75db5b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-75db5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-75db5b-978fb4c from 0 to 1
(x3)

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Unhealthy

Readiness probe failed: Get "https://10.132.0.43:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5

Started

Container started
(x3)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Unhealthy

Readiness probe failed: Get "https://10.132.0.41:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5

Created

Container created
(x2)

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kd2xs

Unhealthy

Readiness probe failed: Get "https://10.134.0.48:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-xnbks

Unhealthy

Readiness probe failed: Get "https://10.132.0.42:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-kjqbj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

Killing

Stopping container istio-proxy

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fxd9d

Unhealthy

Readiness probe failed: Get "https://10.132.0.43:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-fjzzf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-vkvvv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-dn2lp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-hbr58

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jh9hp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Unhealthy

Startup probe failed: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

ProbeError

Startup probe error: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-gbgtf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

ProbeError

Startup probe error: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

Unhealthy

Startup probe failed: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

ProbeError

Readiness probe error: Get "http://10.134.0.181:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Unhealthy

Readiness probe failed: Get "http://10.134.0.181:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-czpj2

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-njx57

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-a9def7-openshift-default-7fd85dc557-jctdp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65

SuccessfulCreate

Created pod: e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

openshift-ingress

replicaset-controller

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65

SuccessfulCreate

Created pod: e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

openshift-ingress

replicaset-controller

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65

SuccessfulCreate

Created pod: e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f82846-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-b-f82846-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f82846-openshift-default-5cb5cd7b65 from 1 to 4

openshift-ingress

multus

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

Started

Container started

openshift-ingress

multus

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

ProbeError

Readiness probe error: Get "http://10.132.0.150:15021/healthz/ready": read tcp 10.132.0.2:40576->10.132.0.150:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

Unhealthy

Readiness probe failed: Get "http://10.132.0.150:15021/healthz/ready": read tcp 10.132.0.2:40576->10.132.0.150:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

ProbeError

Startup probe error: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

Unhealthy

Startup probe failed: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

Unhealthy

Startup probe failed: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

ProbeError

Startup probe error: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg
(x2)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

Unhealthy

Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

ProbeError

Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-48c52b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-b-48c52b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-48c52b-openshift-default-6d88cd8ddc from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

Started

Container started

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

Started

Container started

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

Created

Container created

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

Created

Container created

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

Created

Container created

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-a-b80d5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b80d5b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449

SuccessfulCreate

Created pod: e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk
(x5)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f82846-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f82846-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

Unhealthy

Startup probe failed: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

ProbeError

Startup probe error: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-48c52b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-48c52b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-edc2d3-5d7fdf7bb7-cbrvg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-edc2d3-869f9df58d-g4hzf

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b80d5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b80d5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f82846-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f82846-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-wv47j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-hpgf4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4nr85

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-pdjrr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-jqftg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-5s69z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-9ae129-openshift-default-65fc746555-g28qc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-bfnbt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-7lj9h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-b-48c52b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-48c52b-openshift-default-6d88cd8ddc from 4 to 8

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-4x74z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-48c52b-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

Created

Container created

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-27cda7-7c46895b59-pdq5s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

Started

Container started

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

Created

Container created

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

Started

Container started

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

Created

Container created

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

Created

Container created

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

Started

Container started

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

ProbeError

Readiness probe error: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-edc2d3-openshift-default-7c9467cc57-vkfhs

Unhealthy

Readiness probe failed: Get "http://10.134.0.193:15021/healthz/ready": dial tcp 10.134.0.193:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-27cda7-5c5854cd64-v8zvj

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b80d5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b80d5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f82846-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65

SuccessfulCreate

Created pod: e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

openshift-ingress

deployment-controller

e2e-ipp-b-f82846-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f82846-openshift-default-5cb5cd7b65 from 4 to 5

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

ProbeError

Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

Unhealthy

Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-48c52b-6f648586cf-nclwj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-48c52b-6b84fd4d5b-6lx5b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-696cb4656d-5mkm5

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-48c52b-openshift-default-6d88cd8ddc

SuccessfulCreate

Created pod: e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-48c52b-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-api-b-48c52b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-48c52b-openshift-default-6d88cd8ddc from 8 to 9

openshift-ingress

multus

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Unhealthy

Liveness probe failed: Get "https://10.132.0.41:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

Created

Container created
(x4)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-fqldg

Unhealthy

Readiness probe failed: Get "https://10.132.0.41:8000/ready": context deadline exceeded
(x4)

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-tbk7p

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

ProbeError

Readiness probe error: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Unhealthy

Readiness probe failed: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

ProbeError

Readiness probe error: Get "http://10.134.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

ProbeError

Readiness probe error: Get "http://10.134.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Unhealthy

Readiness probe failed: Get "http://10.134.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Unhealthy

Readiness probe failed: Get "http://10.134.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Unhealthy

Readiness probe failed: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

ProbeError

Readiness probe error: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-978fb4c-khzz2

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.174:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

ProbeError

Readiness probe error: Get "http://10.134.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-srchd

Unhealthy

Liveness probe failed: Get "http://10.133.0.18:6080/livez": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Unhealthy

Readiness probe failed: Get "http://10.134.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

ProbeError

Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

ProbeError

Readiness probe error: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Unhealthy

Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

ProbeError

Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

Unhealthy

Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

ProbeError

Readiness probe error: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

Unhealthy

Readiness probe failed: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

Unhealthy

Readiness probe failed: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-b-75db5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-75db5b-openshift-default-84786bddf5 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-75db5b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x9)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-75db5b-openshift-default-84786bddf5

SuccessfulCreate

Created pod: e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

openshift-ingress

multus

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-75db5b-openshift-default-84786bddf5

SuccessfulCreate

Created pod: e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

openshift-ingress

replicaset-controller

e2e-ipp-b-75db5b-openshift-default-84786bddf5

SuccessfulCreate

Created pod: e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

Created

Container created

openshift-ingress

multus

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

AddedInterface

Add eth0 [10.134.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-27cda7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-27cda7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

ProbeError

Readiness probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Unhealthy

Readiness probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

ProbeError

Startup probe error: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

Unhealthy

Startup probe failed: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

Unhealthy

Startup probe failed: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

ProbeError

Startup probe error: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-75db5b: serviceaccount "payload-processing-e2e-ipp-b-75db5b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9
(x7)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

ProbeError

Startup probe error: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-75db5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-75db5b-7fc7f76d46 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-75db5b: serviceaccount "payload-processing-e2e-ipp-b-75db5b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-75db5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

Unhealthy

Startup probe failed: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-27cda7-openshift-default-86df67d6bf-8dkr5

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f82846-776b6998c6-vzxz2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f82846-f95f6956c-pxr7r

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-75db5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-75db5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-2lwl8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-nlkdv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-zlrtc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-mhmxp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f82846-openshift-default-5cb5cd7b65-h2wcm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4e8583-898d6767-2nbqx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4e8583-d95bddb4d-zlfpj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-75db5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-75db5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4e8583-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4e8583-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-cj7rc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-wmn2v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-mwg9p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-fcq79

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bkr68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-dmfjg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-xh2bv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-bnw5h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-48c52b-openshift-default-6d88cd8ddc-s4wjg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-4e8583-openshift-default-674465474f-zbzkl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-b-75db5b-openshift-default-84786bddf5

SuccessfulCreate

Created pod: e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-75db5b-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-75db5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-75db5b-openshift-default-84786bddf5 from 4 to 5

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

Created

Container created
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-4fm7q

Unhealthy

Readiness probe failed: Get "https://10.134.0.49:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b31f3f-5dff599f7f-29wxx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

Unhealthy

Readiness probe failed: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

ProbeError

Readiness probe error: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b31f3f-6fb8674d76-whjf2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

ProbeError

Readiness probe error: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

Unhealthy

Readiness probe failed: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

Unhealthy

Readiness probe failed: Get "http://10.134.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

ProbeError

Readiness probe error: Get "http://10.134.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-srchd

Unhealthy

Readiness probe failed: Get "http://10.133.0.18:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

ProbeError

Readiness probe error: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

Unhealthy

Readiness probe failed: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x12)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

Unhealthy

Startup probe failed: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

ProbeError

Startup probe error: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

Unhealthy

Readiness probe failed: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b80d5b-547d67599f-xfgsp

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

ProbeError

Readiness probe error: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b80d5b-69f7db55b4-5mbc5

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-a940bc-87d7d7779-b4sfq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-a940bc-7db76d54cb-2s9jr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-pv298

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

Killing

Stopping container istio-proxy
(x8)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-b80d5b-openshift-default-5bc5ddc449-nd8fk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-pgxgf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-6295z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-xvds7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-bkwdh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wpxds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-684wk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-qm22h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-27krg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-dlpd9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-b31f3f-openshift-default-55bc8ff4ff-wvqnw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-743a5e-8db88755-cc8rk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-743a5e-d4b59856b-xhqfr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-75db5b-7fc7f76d46-97vb9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-75db5b-9fc6687d7-jstq8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-n6wbf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-nvzzc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-2b8gq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-vjmbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wh2tt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-bjd5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-jrvvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-4qm6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-mzpw5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w6-a940bc-openshift-default-6d694cb79f-wk4p9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-vxpl2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-zfmhb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-lhh5p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-f2r5m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-pgrk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-75db5b-openshift-default-84786bddf5-wt6hz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-q56sp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-jbxcr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-bkxxf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-j6zg6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-fmgg6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-xd57h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-cvm49

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-tgj46

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-743a5e-openshift-default-cd5b4c9d5-7lpw6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f363a3-9ddf6b767-dlrq6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f363a3-747b47546-v8pdp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

ProbeError

Readiness probe error: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

Unhealthy

Readiness probe failed: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e4e24e-5cd44579cb-nvx76

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-jw92s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-4hqzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-gh8x6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-hcfg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-fd628

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-dq4tr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-bcqmw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-25bqk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e4e24e-7d799d8fb7-557ks

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-w675c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-e4e24e-openshift-default-d477c4d55-42gbv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-svcsn

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-svcsn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5mvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-crrsb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-v7cn8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-zbrz8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-45z2w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-8ws8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-g5ctw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-765hn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-gg5nw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f363a3-openshift-default-66498c7fb7-2287s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a9e67f-6fbfd85f76-4bpxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a9e67f-dcf9ddb6c-bc8f7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-9lt4z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-6xx7p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-mfzs9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-l2w9f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-j2hfn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-a9e67f-openshift-default-f9595bbb9-d42vm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8a9e5f-5979656864-vjgwr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8a9e5f-df657cd95-8nqkd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-9knmz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-llz75

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-4bjw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-cc2vx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-fqjcr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-tkfd6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-7f2vt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-kzcrd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-hpmr4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8a9e5f-openshift-default-5c996d895f-87s9z

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-zlz8n

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-zlz8n

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-wrfmq

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrfmq

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 4 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-j6f7m

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-j6f7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-g8rvj

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-g8rvj

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-9xmcs

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 3 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-9xmcs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 2 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-krsk7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-krsk7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target