=== events in openshift-ingress (2026-11-03T20:25:50Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 44m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm to ip-10-0-134-222.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww to ip-10-0-134-222.us-east-2.compute.internal 36m Normal Scheduled pod/payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr to ip-10-0-131-234.us-east-2.compute.internal 33m Normal Scheduled pod/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 to ip-10-0-134-222.us-east-2.compute.internal 35m Normal Scheduled pod/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 to ip-10-0-131-234.us-east-2.compute.internal 27m Warning FailedScheduling pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 24m Normal Scheduled pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Successfully assigned openshift-ingress/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh to ip-10-0-131-234.us-east-2.compute.internal 24m Warning FailedScheduling pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Normal Scheduled pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Successfully assigned openshift-ingress/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr to ip-10-0-131-234.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 to ip-10-0-134-222.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz to ip-10-0-134-222.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 to ip-10-0-133-204.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs to ip-10-0-134-222.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Successfully assigned openshift-ingress/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Successfully assigned openshift-ingress/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 to ip-10-0-134-222.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv to ip-10-0-133-204.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl to ip-10-0-131-234.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n to ip-10-0-134-222.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 to ip-10-0-131-234.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j to ip-10-0-134-222.us-east-2.compute.internal 5m19s Normal Scheduled pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Successfully assigned openshift-ingress/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw to ip-10-0-131-234.us-east-2.compute.internal 24m Warning FailedScheduling pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 24m Normal Scheduled pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Successfully assigned openshift-ingress/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 to ip-10-0-134-222.us-east-2.compute.internal 38m Normal Scheduled pod/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp to ip-10-0-133-204.us-east-2.compute.internal 32m Normal Scheduled pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Successfully assigned openshift-ingress/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr to ip-10-0-131-234.us-east-2.compute.internal 37m Normal Scheduled pod/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn to ip-10-0-131-234.us-east-2.compute.internal 5m14s Normal Scheduled pod/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf to ip-10-0-131-234.us-east-2.compute.internal 38m Normal Scheduled pod/payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn to ip-10-0-133-204.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Successfully assigned openshift-ingress/e2e-inf-b-332694-openshift-default-5c5687c879-546fr to ip-10-0-134-222.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Successfully assigned openshift-ingress/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm to ip-10-0-133-204.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Successfully assigned openshift-ingress/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz to ip-10-0-133-204.us-east-2.compute.internal 22m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 to ip-10-0-134-222.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z to ip-10-0-133-204.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 Successfully assigned openshift-ingress/e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 to ip-10-0-131-234.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Successfully assigned openshift-ingress/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 to ip-10-0-134-222.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps to ip-10-0-131-234.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt to ip-10-0-134-222.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 to ip-10-0-133-204.us-east-2.compute.internal 45m Normal Scheduled pod/payload-pre-processing-7b98bb678c-76c4k Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-76c4k to ip-10-0-133-204.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf to ip-10-0-134-222.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 to ip-10-0-131-234.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Successfully assigned openshift-ingress/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf to ip-10-0-131-234.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf to ip-10-0-134-222.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj to ip-10-0-131-234.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Successfully assigned openshift-ingress/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 to ip-10-0-133-204.us-east-2.compute.internal 8m8s Normal Scheduled pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Successfully assigned openshift-ingress/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf to ip-10-0-133-204.us-east-2.compute.internal 11m Normal Scheduled pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Successfully assigned openshift-ingress/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 to ip-10-0-134-222.us-east-2.compute.internal 22m Normal Scheduled pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Successfully assigned openshift-ingress/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb to ip-10-0-131-234.us-east-2.compute.internal 17m Normal Scheduled pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Successfully assigned openshift-ingress/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk to ip-10-0-133-204.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm to ip-10-0-131-234.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Successfully assigned openshift-ingress/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 to ip-10-0-133-204.us-east-2.compute.internal 32m Normal Scheduled pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Successfully assigned openshift-ingress/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 to ip-10-0-131-234.us-east-2.compute.internal 54m Normal Scheduled pod/router-default-569d4c45f-7pszr Successfully assigned openshift-ingress/router-default-569d4c45f-7pszr to ip-10-0-134-222.us-east-2.compute.internal 54m Warning FailedScheduling pod/router-default-569d4c45f-7pszr no nodes available to schedule pods 60m Warning FailedScheduling pod/router-default-569d4c45f-7pszr no nodes available to schedule pods 40m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m to ip-10-0-134-222.us-east-2.compute.internal 32m Normal Scheduled pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Successfully assigned openshift-ingress/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm to ip-10-0-133-204.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m to ip-10-0-133-204.us-east-2.compute.internal 34m Normal Scheduled pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Successfully assigned openshift-ingress/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 to ip-10-0-131-234.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Successfully assigned openshift-ingress/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt to ip-10-0-134-222.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Successfully assigned openshift-ingress/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 to ip-10-0-133-204.us-east-2.compute.internal 22m Normal Scheduled pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Successfully assigned openshift-ingress/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 to ip-10-0-134-222.us-east-2.compute.internal 21m Normal Scheduled pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Successfully assigned openshift-ingress/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Successfully assigned openshift-ingress/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls to ip-10-0-134-222.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 to ip-10-0-134-222.us-east-2.compute.internal 35m Normal Scheduled pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Successfully assigned openshift-ingress/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 to ip-10-0-133-204.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k to ip-10-0-133-204.us-east-2.compute.internal 20m Normal Scheduled pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Successfully assigned openshift-ingress/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c to ip-10-0-134-222.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 to ip-10-0-134-222.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t to ip-10-0-131-234.us-east-2.compute.internal 22m Normal Scheduled pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Successfully assigned openshift-ingress/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 to ip-10-0-131-234.us-east-2.compute.internal 37m Normal Scheduled pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Successfully assigned openshift-ingress/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg to ip-10-0-131-234.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts to ip-10-0-133-204.us-east-2.compute.internal 21m Normal Scheduled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Successfully assigned openshift-ingress/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt to ip-10-0-134-222.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 to ip-10-0-131-234.us-east-2.compute.internal 33m Normal Scheduled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Successfully assigned openshift-ingress/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 to ip-10-0-133-204.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Successfully assigned openshift-ingress/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt to ip-10-0-131-234.us-east-2.compute.internal 34m Normal Scheduled pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Successfully assigned openshift-ingress/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 to ip-10-0-133-204.us-east-2.compute.internal 21m Normal Scheduled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Successfully assigned openshift-ingress/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r to ip-10-0-131-234.us-east-2.compute.internal 21m Normal Scheduled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Successfully assigned openshift-ingress/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 to ip-10-0-131-234.us-east-2.compute.internal 35m Normal Scheduled pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Successfully assigned openshift-ingress/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl to ip-10-0-134-222.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr to ip-10-0-134-222.us-east-2.compute.internal 22m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 to ip-10-0-134-222.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 to ip-10-0-133-204.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Successfully assigned openshift-ingress/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd to ip-10-0-134-222.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn to ip-10-0-133-204.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Successfully assigned openshift-ingress/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn to ip-10-0-133-204.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Successfully assigned openshift-ingress/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s to ip-10-0-133-204.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Successfully assigned openshift-ingress/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 to ip-10-0-133-204.us-east-2.compute.internal 35m Normal Scheduled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Successfully assigned openshift-ingress/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj to ip-10-0-134-222.us-east-2.compute.internal 37m Normal Scheduled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Successfully assigned openshift-ingress/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 to ip-10-0-131-234.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk to ip-10-0-133-204.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb to ip-10-0-131-234.us-east-2.compute.internal 23m Normal Scheduled pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Successfully assigned openshift-ingress/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp to ip-10-0-133-204.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Successfully assigned openshift-ingress/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 to ip-10-0-133-204.us-east-2.compute.internal 20m Normal Scheduled pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Successfully assigned openshift-ingress/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 to ip-10-0-131-234.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 to ip-10-0-133-204.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Successfully assigned openshift-ingress/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 to ip-10-0-133-204.us-east-2.compute.internal 26m Normal Scheduled pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Successfully assigned openshift-ingress/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq to ip-10-0-133-204.us-east-2.compute.internal 35m Normal Scheduled pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Successfully assigned openshift-ingress/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw to ip-10-0-131-234.us-east-2.compute.internal 35m Normal Scheduled pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Successfully assigned openshift-ingress/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb to ip-10-0-133-204.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 Successfully assigned openshift-ingress/e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 to ip-10-0-131-234.us-east-2.compute.internal 50m Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-b5ctg Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-b5ctg to ip-10-0-131-234.us-east-2.compute.internal 26m Warning FailedScheduling pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 28m Warning FailedScheduling pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 30m Normal Scheduled pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Successfully assigned openshift-ingress/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn to ip-10-0-133-204.us-east-2.compute.internal 8m3s Normal Scheduled pod/payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb to ip-10-0-131-234.us-east-2.compute.internal 11m Normal Scheduled pod/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz to ip-10-0-131-234.us-east-2.compute.internal 22m Normal Scheduled pod/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw to ip-10-0-134-222.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Successfully assigned openshift-ingress/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh to ip-10-0-131-234.us-east-2.compute.internal 26m Warning FailedScheduling pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 31m Normal Scheduled pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Successfully assigned openshift-ingress/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm to ip-10-0-131-234.us-east-2.compute.internal 33m Normal Scheduled pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Successfully assigned openshift-ingress/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb to ip-10-0-131-234.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Successfully assigned openshift-ingress/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p to ip-10-0-134-222.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r to ip-10-0-131-234.us-east-2.compute.internal 38m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9r5ng to ip-10-0-133-204.us-east-2.compute.internal 22m Normal Scheduled pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Successfully assigned openshift-ingress/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r to ip-10-0-131-234.us-east-2.compute.internal 36m Normal Scheduled pod/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 to ip-10-0-131-234.us-east-2.compute.internal 23m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd to ip-10-0-131-234.us-east-2.compute.internal 34m Normal Scheduled pod/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c to ip-10-0-134-222.us-east-2.compute.internal 38m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-crz4q to ip-10-0-134-222.us-east-2.compute.internal 24m Normal Scheduled pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Successfully assigned openshift-ingress/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d to ip-10-0-134-222.us-east-2.compute.internal 24m Warning FailedScheduling pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 26m Warning FailedScheduling pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 43m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-rfxvm Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rfxvm to ip-10-0-134-222.us-east-2.compute.internal 47m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-zszqv to ip-10-0-131-234.us-east-2.compute.internal 35m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 to ip-10-0-134-222.us-east-2.compute.internal 4m42s Normal Scheduled pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Successfully assigned openshift-ingress/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf to ip-10-0-131-234.us-east-2.compute.internal 36m Normal Scheduled pod/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm to ip-10-0-131-234.us-east-2.compute.internal 22m Normal Scheduled pod/payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 to ip-10-0-134-222.us-east-2.compute.internal 22m Normal Scheduled pod/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m to ip-10-0-134-222.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Successfully assigned openshift-ingress/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm to ip-10-0-133-204.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Successfully assigned openshift-ingress/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 to ip-10-0-133-204.us-east-2.compute.internal 37m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj to ip-10-0-131-234.us-east-2.compute.internal 48m Normal Scheduled pod/data-science-gateway-data-science-gateway-class-6c786f9b57rcpnr Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57rcpnr to ip-10-0-134-222.us-east-2.compute.internal 49m Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-7454465567-vr74f Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-7454465567-vr74f to ip-10-0-134-222.us-east-2.compute.internal 37m Normal Scheduled pod/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n to ip-10-0-133-204.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq to ip-10-0-131-234.us-east-2.compute.internal 35m Normal Scheduled pod/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 to ip-10-0-134-222.us-east-2.compute.internal 35m Normal Scheduled pod/payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh to ip-10-0-134-222.us-east-2.compute.internal 36m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 to ip-10-0-131-234.us-east-2.compute.internal 35m Normal Scheduled pod/payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg to ip-10-0-131-234.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk Successfully assigned openshift-ingress/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk to ip-10-0-133-204.us-east-2.compute.internal 38m Normal Scheduled pod/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm to ip-10-0-131-234.us-east-2.compute.internal 29m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 to ip-10-0-134-222.us-east-2.compute.internal 29m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx to ip-10-0-133-204.us-east-2.compute.internal 28m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs to ip-10-0-133-204.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Successfully assigned openshift-ingress/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 to ip-10-0-131-234.us-east-2.compute.internal 29m Warning FailedScheduling pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 48m Normal Scheduled pod/kube-auth-proxy-f46798c78-7wgg6 Successfully assigned openshift-ingress/kube-auth-proxy-f46798c78-7wgg6 to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Successfully assigned openshift-ingress/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 to ip-10-0-131-234.us-east-2.compute.internal 28m Warning FailedScheduling pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-7ssb8 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 21m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv to ip-10-0-134-222.us-east-2.compute.internal 22m Normal Scheduled pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Successfully assigned openshift-ingress/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx to ip-10-0-133-204.us-east-2.compute.internal 37m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq to ip-10-0-131-234.us-east-2.compute.internal 24m Warning FailedScheduling pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-7ssb8 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 48m Normal Scheduled pod/kube-auth-proxy-f46798c78-dmhc8 Successfully assigned openshift-ingress/kube-auth-proxy-f46798c78-dmhc8 to ip-10-0-133-204.us-east-2.compute.internal 37m Normal Scheduled pod/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 to ip-10-0-131-234.us-east-2.compute.internal 23m Normal Scheduled pod/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h to ip-10-0-131-234.us-east-2.compute.internal 36m Normal Scheduled pod/payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 Successfully assigned openshift-ingress/payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 to ip-10-0-131-234.us-east-2.compute.internal 35m Normal Scheduled pod/payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr Successfully assigned openshift-ingress/payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr to ip-10-0-134-222.us-east-2.compute.internal 33m Normal Scheduled pod/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 to ip-10-0-134-222.us-east-2.compute.internal 27m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 23m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 23m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp to ip-10-0-133-204.us-east-2.compute.internal 4m38s Normal Scheduled pod/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv Successfully assigned openshift-ingress/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Successfully assigned openshift-ingress/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl to ip-10-0-133-204.us-east-2.compute.internal 34m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 to ip-10-0-134-222.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk to ip-10-0-131-234.us-east-2.compute.internal 38m Normal Scheduled pod/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss to ip-10-0-134-222.us-east-2.compute.internal 30m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk to ip-10-0-133-204.us-east-2.compute.internal 27m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 23m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 23m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx to ip-10-0-134-222.us-east-2.compute.internal 38m Normal Scheduled pod/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 to ip-10-0-131-234.us-east-2.compute.internal 29m Normal Scheduled pod/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z to ip-10-0-133-204.us-east-2.compute.internal 29m Normal Scheduled pod/payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm to ip-10-0-133-204.us-east-2.compute.internal 28m Normal Scheduled pod/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn to ip-10-0-133-204.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk to ip-10-0-131-234.us-east-2.compute.internal 28m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 27m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 26m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk to ip-10-0-134-222.us-east-2.compute.internal 28m Normal Scheduled pod/payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl to ip-10-0-134-222.us-east-2.compute.internal 31m Normal Scheduled pod/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l to ip-10-0-134-222.us-east-2.compute.internal 30m Normal Scheduled pod/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn to ip-10-0-134-222.us-east-2.compute.internal 36m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Successfully assigned openshift-ingress/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg to ip-10-0-131-234.us-east-2.compute.internal 21m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 to ip-10-0-134-222.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Successfully assigned openshift-ingress/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-57ktj to ip-10-0-133-204.us-east-2.compute.internal 21m Normal Scheduled pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Successfully assigned openshift-ingress/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 to ip-10-0-131-234.us-east-2.compute.internal 45m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-76cxc to ip-10-0-133-204.us-east-2.compute.internal 38m Normal Scheduled pod/payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 Successfully assigned openshift-ingress/payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 to ip-10-0-133-204.us-east-2.compute.internal 4m38s Normal Scheduled pod/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh Successfully assigned openshift-ingress/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh to ip-10-0-131-234.us-east-2.compute.internal 33m Normal Scheduled pod/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 to ip-10-0-134-222.us-east-2.compute.internal 35m Normal Scheduled pod/payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 Successfully assigned openshift-ingress/payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 to ip-10-0-134-222.us-east-2.compute.internal 31m Normal Scheduled pod/payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp to ip-10-0-133-204.us-east-2.compute.internal 33m Normal Scheduled pod/payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd to ip-10-0-134-222.us-east-2.compute.internal 35m Normal Scheduled pod/payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m Successfully assigned openshift-ingress/payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt Successfully assigned openshift-ingress/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp to ip-10-0-131-234.us-east-2.compute.internal 45m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-7n48w to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl to ip-10-0-131-234.us-east-2.compute.internal 21m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t to ip-10-0-131-234.us-east-2.compute.internal 24m Normal Scheduled pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Successfully assigned openshift-ingress/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb to ip-10-0-134-222.us-east-2.compute.internal 24m Warning FailedScheduling pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Normal Scheduled pod/payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv Successfully assigned openshift-ingress/payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv to ip-10-0-131-234.us-east-2.compute.internal 25m Warning FailedScheduling pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 31m Normal Scheduled pod/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f to ip-10-0-131-234.us-east-2.compute.internal 32m Normal Scheduled pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Successfully assigned openshift-ingress/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-g74zd to ip-10-0-131-234.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 to ip-10-0-133-204.us-east-2.compute.internal 16m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg to ip-10-0-133-204.us-east-2.compute.internal 16m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 to ip-10-0-134-222.us-east-2.compute.internal 16m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx to ip-10-0-133-204.us-east-2.compute.internal 37m Normal Scheduled pod/payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth Successfully assigned openshift-ingress/payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth to ip-10-0-131-234.us-east-2.compute.internal 5m14s Normal Scheduled pod/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 Successfully assigned openshift-ingress/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 to ip-10-0-131-234.us-east-2.compute.internal 22m Normal Scheduled pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Successfully assigned openshift-ingress/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk to ip-10-0-133-204.us-east-2.compute.internal 44m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr to ip-10-0-134-222.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Successfully assigned openshift-ingress/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj to ip-10-0-131-234.us-east-2.compute.internal 28m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 27m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l to ip-10-0-131-234.us-east-2.compute.internal 45m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v to ip-10-0-131-234.us-east-2.compute.internal 22m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk to ip-10-0-134-222.us-east-2.compute.internal 11m Normal Scheduled pod/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 to ip-10-0-131-234.us-east-2.compute.internal 16m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-tdppc to ip-10-0-131-234.us-east-2.compute.internal 49m Normal Scheduled pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx to ip-10-0-134-222.us-east-2.compute.internal 38m Normal Scheduled pod/payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml Successfully assigned openshift-ingress/payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Successfully assigned openshift-ingress/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr to ip-10-0-133-204.us-east-2.compute.internal 27m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 24m Warning FailedScheduling pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 23m Normal Scheduled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Successfully assigned openshift-ingress/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq to ip-10-0-133-204.us-east-2.compute.internal 33m Normal Scheduled pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Successfully assigned openshift-ingress/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv to ip-10-0-133-204.us-east-2.compute.internal 31m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm to ip-10-0-134-222.us-east-2.compute.internal 8m3s Normal Scheduled pod/payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd to ip-10-0-131-234.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 to ip-10-0-131-234.us-east-2.compute.internal 30m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf to ip-10-0-134-222.us-east-2.compute.internal 28m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx to ip-10-0-134-222.us-east-2.compute.internal 45m Normal Scheduled pod/payload-processing-55fbbbf9dc-j9kp5 Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-j9kp5 to ip-10-0-133-204.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Successfully assigned openshift-ingress/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x to ip-10-0-133-204.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Successfully assigned openshift-ingress/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm to ip-10-0-134-222.us-east-2.compute.internal 28m Warning FailedScheduling pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 61m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-569d4c45f from 0 to 1 61m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 61m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 61m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 61m Warning FailedCreate replicaset/router-default-569d4c45f Error creating: pods "router-default-569d4c45f-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range 60m Normal SuccessfulCreate replicaset/router-default-569d4c45f Created pod: router-default-569d4c45f-7pszr 54m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 54m Warning FailedMount pod/router-default-569d4c45f-7pszr MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 54m Warning FailedMount pod/router-default-569d4c45f-7pszr MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 54m Warning FailedMount pod/router-default-569d4c45f-7pszr MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 54m Normal Pulled pod/router-default-569d4c45f-7pszr Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/router-default-569d4c45f-7pszr Add eth0 [10.132.0.13/23] from ovn-kubernetes 54m Normal Created pod/router-default-569d4c45f-7pszr Container created 54m Normal Started pod/router-default-569d4c45f-7pszr Container started 50m Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 50m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 50m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-b5ctg 50m Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-b5ctg Add eth0 [10.133.0.20/23] from ovn-kubernetes 50m Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-b5ctg Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 49m Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-b5ctg Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.643s (4.643s including waiting). Image size: 185476477 bytes. 49m Normal Created pod/istiod-openshift-gateway-7876bfcb74-b5ctg Container created 49m Normal Started pod/istiod-openshift-gateway-7876bfcb74-b5ctg Container started 49m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 0 to 1 49m Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 49m Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-7454465567 Created pod: openshift-ai-inference-openshift-ai-inference-7454465567-vr74f 49m Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-7454465567 from 0 to 1 49m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-zl5bx 49m Normal Pulling pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 49m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Add eth0 [10.132.0.32/23] from ovn-kubernetes 49m Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-7454465567-vr74f Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 49m Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-7454465567-vr74f Add eth0 [10.132.0.33/23] from ovn-kubernetes 49m Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 49m Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-7454465567-vr74f Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.841s (9.841s including waiting). Image size: 183555333 bytes. 49m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.856s (9.856s including waiting). Image size: 183555333 bytes. 49m Normal Started pod/openshift-ai-inference-openshift-ai-inference-7454465567-vr74f Container started 49m Normal Created pod/openshift-ai-inference-openshift-ai-inference-7454465567-vr74f Container created 49m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 49m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 49m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 49m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Normal SuccessfulCreate replicaset/kube-auth-proxy-f46798c78 Created pod: kube-auth-proxy-f46798c78-7wgg6 48m Normal SuccessfulCreate replicaset/kube-auth-proxy-f46798c78 Created pod: kube-auth-proxy-f46798c78-dmhc8 48m Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-f46798c78 from 0 to 2 48m Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-6c786f9b57 Created pod: data-science-gateway-data-science-gateway-class-6c786f9b57rcpnr 48m Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-6c786f9b57 from 0 to 1 48m Normal AddedInterface pod/kube-auth-proxy-f46798c78-dmhc8 Add eth0 [10.134.0.25/23] from ovn-kubernetes 48m Normal AddedInterface pod/kube-auth-proxy-f46798c78-7wgg6 Add eth0 [10.133.0.22/23] from ovn-kubernetes 48m Normal Pulling pod/kube-auth-proxy-f46798c78-7wgg6 Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 48m Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-6c786f9b57rcpnr Add eth0 [10.132.0.43/23] from ovn-kubernetes 48m Normal Pulling pod/kube-auth-proxy-f46798c78-dmhc8 Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 48m Normal Started pod/data-science-gateway-data-science-gateway-class-6c786f9b57rcpnr Container started 48m Normal Created pod/data-science-gateway-data-science-gateway-class-6c786f9b57rcpnr Container created 48m Normal Pulled pod/data-science-gateway-data-science-gateway-class-6c786f9b57rcpnr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Created pod/kube-auth-proxy-f46798c78-7wgg6 Container created 48m Normal Pulled pod/kube-auth-proxy-f46798c78-7wgg6 Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.43s (2.43s including waiting). Image size: 188904677 bytes. 48m Normal Started pod/kube-auth-proxy-f46798c78-7wgg6 Container started 48m Normal Started pod/kube-auth-proxy-f46798c78-dmhc8 Container started 48m Normal Created pod/kube-auth-proxy-f46798c78-dmhc8 Container created 48m Normal Pulled pod/kube-auth-proxy-f46798c78-dmhc8 Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.876s (2.876s including waiting). Image size: 188904677 bytes. 48m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 47m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 47m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 47m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Add eth0 [10.133.0.24/23] from ovn-kubernetes 47m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 47m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-zszqv 47m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Container started 47m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Container created 47m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 47m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Readiness probe failed: HTTP probe failed with statuscode: 503 47m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Readiness probe error: HTTP probe failed with statuscode: 503... 47m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 47m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-b5ctg 47m Normal Killing pod/istiod-openshift-gateway-7876bfcb74-b5ctg Stopping container discovery 47m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 47m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 47m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 47m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 46m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Container created 46m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Container started 46m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused 46m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-zl5bx Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused... 46m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 46m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 45m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 45m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-7n48w 45m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 1 to 4 45m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-t5g9v 45m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-76cxc 45m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 45m Normal Pulling pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 45m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Add eth0 [10.134.0.38/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Add eth0 [10.133.0.31/23] from ovn-kubernetes 45m Normal Pulling pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 45m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Add eth0 [10.133.0.30/23] from ovn-kubernetes 45m Normal Pulling pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 45m Warning FailedCreate replicaset/payload-pre-processing-7b98bb678c Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 45m Normal ScalingReplicaSet deployment/payload-processing Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1 45m Normal SuccessfulCreate replicaset/payload-pre-processing-7b98bb678c Created pod: payload-pre-processing-7b98bb678c-76c4k 45m Normal ScalingReplicaSet deployment/payload-pre-processing Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 45m Warning FailedCreate replicaset/payload-processing-55fbbbf9dc Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 45m Normal SuccessfulCreate replicaset/payload-processing-55fbbbf9dc Created pod: payload-processing-55fbbbf9dc-j9kp5 45m Normal Pulling pod/payload-processing-55fbbbf9dc-j9kp5 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 45m Normal Pulling pod/payload-pre-processing-7b98bb678c-76c4k Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 45m Normal AddedInterface pod/payload-pre-processing-7b98bb678c-76c4k Add eth0 [10.134.0.39/23] from ovn-kubernetes 45m Normal AddedInterface pod/payload-processing-55fbbbf9dc-j9kp5 Add eth0 [10.134.0.40/23] from ovn-kubernetes 45m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Container created 45m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Container started 45m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.01s (3.01s including waiting). Image size: 183555333 bytes. 45m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Container created 45m Normal Pulled pod/payload-processing-55fbbbf9dc-j9kp5 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.632s (2.632s including waiting). Image size: 125353963 bytes. 45m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Container started 45m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.214s (4.214s including waiting). Image size: 183555333 bytes. 45m Normal Started pod/payload-processing-55fbbbf9dc-j9kp5 Container started 45m Normal Created pod/payload-processing-55fbbbf9dc-j9kp5 Container created 45m Normal Pulled pod/payload-pre-processing-7b98bb678c-76c4k Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.833s (2.833s including waiting). Image size: 125353963 bytes. 45m Normal Created pod/payload-pre-processing-7b98bb678c-76c4k Container created 45m Normal Started pod/payload-pre-processing-7b98bb678c-76c4k Container started 45m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Container started 45m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Container created 45m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.903s (5.903s including waiting). Image size: 183555333 bytes. 45m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused... 45m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused 45m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused... 45m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused 44m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused 44m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused... 44m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-cz4nm 44m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 4 to 8 44m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 44m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-lx2rx 44m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-rl9tr 44m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-bg7cl 44m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Container started 44m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Container created 44m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Add eth0 [10.132.0.58/23] from ovn-kubernetes 44m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Container started 44m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Container created 44m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Add eth0 [10.133.0.33/23] from ovn-kubernetes 44m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Container created 44m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Add eth0 [10.134.0.41/23] from ovn-kubernetes 44m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Container started 44m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Container created 44m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Container started 44m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Add eth0 [10.132.0.57/23] from ovn-kubernetes 44m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused... 44m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused 44m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused... 44m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused 44m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused 44m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused... 44m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused... 44m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused 44m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f (combined from similar events): Created pod: maas-default-gateway-openshift-default-5db77fbd9f-g74zd 44m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-57ktj 44m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 10; reason: 44m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 8 to 10 44m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Add eth0 [10.133.0.34/23] from ovn-kubernetes 44m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Container created 44m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Container started 44m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Container started 44m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Container created 44m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Add eth0 [10.134.0.42/23] from ovn-kubernetes 44m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused... 44m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused... 44m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused 44m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused 44m Normal AddedLabel gateway/e2e-worker-w1-a35658 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-a35658 44m Normal AddedLabel gateway/e2e-worker-w2-8d4127 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-8d4127 44m Normal AddedLabel gateway/e2e-worker-w3-39043d Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-39043d 44m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 44m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Add eth0 [10.133.0.36/23] from ovn-kubernetes 44m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled up replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 0 to 1 44m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled up replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 0 to 1 44m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k 44m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm 44m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z 44m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled up replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 0 to 1 44m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf 44m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Add eth0 [10.134.0.43/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn 44m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled up replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 0 to 1 44m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled up replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 0 to 1 44m Normal AddedLabel gateway/e2e-worker-w0-82dbbf Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-82dbbf 44m Normal AddedLabel gateway/e2e-worker-w5-0486e8 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-0486e8 44m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled up replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 0 to 1 44m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 44m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled up replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 0 to 1 44m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Add eth0 [10.133.0.35/23] from ovn-kubernetes 44m Normal AddedLabel gateway/e2e-worker-w6-102379 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w6-102379 44m Normal AddedLabel gateway/e2e-worker-w4-f4e123 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-f4e123 44m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Add eth0 [10.134.0.44/23] from ovn-kubernetes 44m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Add eth0 [10.134.0.45/23] from ovn-kubernetes 44m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Add eth0 [10.133.0.37/23] from ovn-kubernetes 44m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Add eth0 [10.132.0.59/23] from ovn-kubernetes 44m Warning FailedCreate replicaset/payload-processing-e2e-worker-w3-39043d-5dbd77d679 Error creating: pods "payload-processing-e2e-worker-w3-39043d-5dbd77d679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-39043d: serviceaccount "payload-processing-e2e-worker-w3-39043d" not found 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w3-39043d Scaled up replica set payload-processing-e2e-worker-w3-39043d-5dbd77d679 from 0 to 1 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5 Error creating: pods "payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-39043d: serviceaccount "payload-processing-e2e-worker-w3-39043d" not found 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w3-39043d Scaled up replica set payload-pre-processing-e2e-worker-w3-39043d-66d86796c5 from 0 to 1 44m Normal Created pod/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z Container created 44m Normal Created pod/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn Container created 44m Normal Started pod/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z Container started 44m Normal Pulled pod/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Warning FailedCreate replicaset/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc Error creating: pods "payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a35658: serviceaccount "payload-processing-e2e-worker-w1-a35658" not found 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc Created pod: payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w1-a35658 Scaled up replica set payload-processing-e2e-worker-w1-a35658-7b7d7b89cc from 0 to 1 44m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z Add eth0 [10.134.0.47/23] from ovn-kubernetes 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w1-a35658 Scaled up replica set payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5 from 0 to 1 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5 Created pod: payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5 Error creating: pods "payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a35658: serviceaccount "payload-processing-e2e-worker-w1-a35658" not found 44m Normal AddedInterface pod/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn Add eth0 [10.134.0.46/23] from ovn-kubernetes 44m Normal Pulled pod/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5 Created pod: payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z 44m Normal Started pod/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn Container started 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w3-39043d-5dbd77d679 Created pod: payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn 44m Normal Pulled pod/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Warning FailedCreate replicaset/payload-processing-e2e-worker-w4-f4e123-bc4895fdf Error creating: pods "payload-processing-e2e-worker-w4-f4e123-bc4895fdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f4e123: serviceaccount "payload-processing-e2e-worker-w4-f4e123" not found 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w4-f4e123-bc4895fdf Created pod: payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w4-f4e123 Scaled up replica set payload-processing-e2e-worker-w4-f4e123-bc4895fdf from 0 to 1 44m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 Add eth0 [10.133.0.38/23] from ovn-kubernetes 44m Normal Pulling pod/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w4-f4e123 Scaled up replica set payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699 from 0 to 1 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699 Created pod: payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699 Error creating: pods "payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f4e123: serviceaccount "payload-processing-e2e-worker-w4-f4e123" not found 44m Normal Started pod/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq Container started 44m Normal Created pod/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq Container created 44m Normal AddedInterface pod/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq Add eth0 [10.134.0.48/23] from ovn-kubernetes 44m Normal AddedInterface pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Add eth0 [10.133.0.40/23] from ovn-kubernetes 44m Normal Pulling pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Normal Pulling pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Warning FailedCreate replicaset/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5 Error creating: pods "payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-8d4127: serviceaccount "payload-processing-e2e-worker-w2-8d4127" not found 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5 Created pod: payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 44m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Add eth0 [10.132.0.61/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7 Created pod: payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w2-8d4127 Scaled up replica set payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5 from 0 to 1 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w0-82dbbf Scaled up replica set payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9 from 0 to 1 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9 Created pod: payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9 Error creating: pods "payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-82dbbf: serviceaccount "payload-processing-e2e-worker-w0-82dbbf" not found 44m Warning FailedCreate replicaset/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7 Error creating: pods "payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-82dbbf: serviceaccount "payload-processing-e2e-worker-w0-82dbbf" not found 44m Normal Pulling pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67 Error creating: pods "payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-8d4127: serviceaccount "payload-processing-e2e-worker-w2-8d4127" not found 44m Normal AddedInterface pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Add eth0 [10.133.0.41/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67 Created pod: payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w0-82dbbf Scaled up replica set payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7 from 0 to 1 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w2-8d4127 Scaled up replica set payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67 from 0 to 1 44m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Add eth0 [10.133.0.39/23] from ovn-kubernetes 44m Normal Pulling pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Normal Pulled pod/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w5-0486e8-777477746c Error creating: pods "payload-pre-processing-e2e-worker-w5-0486e8-777477746c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-0486e8: serviceaccount "payload-processing-e2e-worker-w5-0486e8" not found 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w5-0486e8 Scaled up replica set payload-processing-e2e-worker-w5-0486e8-75b78f57d7 from 0 to 1 44m Normal Started pod/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn Container started 44m Normal AddedInterface pod/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn Add eth0 [10.134.0.50/23] from ovn-kubernetes 44m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 Add eth0 [10.133.0.42/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w5-0486e8-75b78f57d7 Created pod: payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg 44m Normal Pulling pod/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Warning FailedCreate replicaset/payload-processing-e2e-worker-w5-0486e8-75b78f57d7 Error creating: pods "payload-processing-e2e-worker-w5-0486e8-75b78f57d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-0486e8: serviceaccount "payload-processing-e2e-worker-w5-0486e8" not found 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w5-0486e8 Scaled up replica set payload-pre-processing-e2e-worker-w5-0486e8-777477746c from 0 to 1 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w5-0486e8-777477746c Created pod: payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj 44m Normal Created pod/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn Container created 44m Warning FailedCreate replicaset/payload-processing-e2e-worker-w6-102379-5c958cc4ff Error creating: pods "payload-processing-e2e-worker-w6-102379-5c958cc4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-102379: serviceaccount "payload-processing-e2e-worker-w6-102379" not found 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff Error creating: pods "payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-102379: serviceaccount "payload-processing-e2e-worker-w6-102379" not found 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w6-102379-5c958cc4ff Created pod: payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls 44m Normal Pulling pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w6-102379 Scaled up replica set payload-processing-e2e-worker-w6-102379-5c958cc4ff from 0 to 1 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w6-102379 Scaled up replica set payload-pre-processing-e2e-worker-w6-102379-64bd4947ff from 0 to 1 44m Normal AddedInterface pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Add eth0 [10.133.0.44/23] from ovn-kubernetes 44m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Add eth0 [10.133.0.43/23] from ovn-kubernetes 44m Normal Pulling pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff Created pod: payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss 44m Normal Pulling pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Normal AddedInterface pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Add eth0 [10.132.0.63/23] from ovn-kubernetes 44m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Add eth0 [10.132.0.62/23] from ovn-kubernetes 44m Normal Pulling pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 44m Normal Created pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Container created 44m Normal Started pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Container started 44m Normal Pulled pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.689s (1.689s including waiting). Image size: 125353963 bytes. 44m Normal Created pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Container created 44m Normal Pulled pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.544s (3.544s including waiting). Image size: 125353963 bytes. 44m Normal Pulled pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.679s (1.679s including waiting). Image size: 125353963 bytes. 44m Normal Created pod/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 Container created 44m Normal Pulled pod/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.626s (5.626s including waiting). Image size: 125353963 bytes. 44m Normal Started pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Container started 44m Normal Started pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Container started 44m Normal Started pod/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 Container started 44m Normal Started pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Container started 44m Normal Created pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Container created 44m Normal Pulled pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.174s (3.174s including waiting). Image size: 125353963 bytes. 44m Normal Pulled pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.042s (3.042s including waiting). Image size: 125353963 bytes. 44m Normal Started pod/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 Container started 44m Normal Created pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Container created 44m Normal Created pod/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 Container created 44m Normal Created pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Container created 44m Normal Started pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Container started 44m Normal Pulled pod/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.842s (3.842s including waiting). Image size: 125353963 bytes. 44m Normal Started pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Container started 44m Normal Started pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Container started 44m Normal Created pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Container created 44m Normal Pulled pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.937s (5.937s including waiting). Image size: 125353963 bytes. 44m Normal Started pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Container started 44m Normal Pulled pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.866s (5.866s including waiting). Image size: 125353963 bytes. 44m Normal Created pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Container created 44m Normal Created pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Container created 44m Normal Pulled pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.519s (5.519s including waiting). Image size: 125353963 bytes. 43m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Container started 43m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Container started 43m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Container created 43m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Container created 43m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused 43m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Container started 43m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused... 43m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Container created 43m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused 43m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Container started 43m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Container created 43m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused... 43m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Container created 43m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Container started 43m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Container started 43m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Container created 43m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 2; reason: cpu resource utilization (percentage of request) above target 43m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Container started 43m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2 43m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Container created 43m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-rfxvm 43m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-rfxvm Add eth0 [10.132.0.66/23] from ovn-kubernetes 43m Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-rfxvm Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 43m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused... 43m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused 43m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused 43m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused 43m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused... 43m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused... 43m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused... 43m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused 43m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-rfxvm Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.011s (4.011s including waiting). Image size: 185476477 bytes. 43m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-rfxvm Container created 43m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-rfxvm Container started 43m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused... 43m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Container started 42m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 42m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 42m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled up replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 1 to 2 42m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Add eth0 [10.133.0.53/23] from ovn-kubernetes 42m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Add eth0 [10.133.0.54/23] from ovn-kubernetes 42m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Container created 42m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs 42m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled up replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 1 to 2 42m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled up replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 1 to 2 42m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 42m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled up replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 1 to 2 42m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Add eth0 [10.133.0.55/23] from ovn-kubernetes 42m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Container created 42m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Container started 42m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Container started 42m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Container started 42m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Container created 42m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Container created 42m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Add eth0 [10.134.0.58/23] from ovn-kubernetes 42m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused 42m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused... 42m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused... 42m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused... 42m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused 42m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused 42m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused... 42m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused 42m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Container started 42m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Container created 42m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Add eth0 [10.134.0.59/23] from ovn-kubernetes 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 42m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled up replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 1 to 2 42m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq 42m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused... 42m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused 42m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 42m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled up replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 1 to 2 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 42m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Container started 42m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Container created 42m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Add eth0 [10.134.0.60/23] from ovn-kubernetes 42m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused... 42m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused 41m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled up replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 2 to 3 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 41m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p 41m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Add eth0 [10.132.0.75/23] from ovn-kubernetes 41m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Container started 41m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Container created 41m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused 41m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused... 41m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt 41m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled up replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 1 to 2 41m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs 41m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled up replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 2 to 3 41m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r 41m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Add eth0 [10.132.0.79/23] from ovn-kubernetes 41m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 41m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 41m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 41m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled up replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 2 to 4 41m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled up replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 2 to 3 41m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled up replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 3 to 4 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 41m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Container started 41m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Add eth0 [10.134.0.62/23] from ovn-kubernetes 41m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Add eth0 [10.132.0.81/23] from ovn-kubernetes 41m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Container created 41m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Add eth0 [10.134.0.61/23] from ovn-kubernetes 41m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Add eth0 [10.132.0.80/23] from ovn-kubernetes 41m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Container created 41m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Container created 41m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Container started 41m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Container started 41m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Container started 41m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Container created 41m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Container created 41m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Add eth0 [10.133.0.71/23] from ovn-kubernetes 41m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Container started 41m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Container created 41m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Container started 41m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused 41m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused... 41m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused... 41m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused... 41m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused 41m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused 41m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused 41m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused... 41m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused 41m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused... 41m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused... 41m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused 41m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled up replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 3 to 4 41m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 41m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled up replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 2 to 4 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 41m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 41m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 41m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Container started 41m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Container created 41m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Add eth0 [10.133.0.74/23] from ovn-kubernetes 41m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr 41m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Container created 41m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 41m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled up replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 2 to 4 41m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Add eth0 [10.132.0.82/23] from ovn-kubernetes 41m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Container started 41m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Container started 41m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Add eth0 [10.132.0.83/23] from ovn-kubernetes 41m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Add eth0 [10.134.0.64/23] from ovn-kubernetes 41m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Container created 41m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Container started 41m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Container created 41m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Add eth0 [10.134.0.65/23] from ovn-kubernetes 41m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Container created 41m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Container started 41m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused... 41m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused 41m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused 41m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused... 41m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused 41m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused... 41m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused... 41m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused... 41m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused 41m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused 41m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled up replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 4 to 5 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 5; reason: 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 41m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps 41m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled up replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 4 to 5 41m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj 41m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Container started 41m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Container started 41m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Container created 41m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 41m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Add eth0 [10.133.0.77/23] from ovn-kubernetes 41m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Container created 41m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 41m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Add eth0 [10.133.0.79/23] from ovn-kubernetes 41m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Container started 41m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled up replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 4 to 5 41m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Container created 41m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Add eth0 [10.133.0.78/23] from ovn-kubernetes 40m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused 40m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused... 40m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 40m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled up replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 5 to 7 40m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 40m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf 40m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled up replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 4 to 8 40m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 40m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled up replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 4 to 7 40m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 40m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth 40m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 40m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf 40m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 40m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Add eth0 [10.134.0.71/23] from ovn-kubernetes 40m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Container created 40m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Add eth0 [10.134.0.69/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Container created 40m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Container started 40m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Container created 40m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Container started 40m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Container started 40m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Container created 40m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Add eth0 [10.133.0.86/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Container started 40m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Container started 40m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Container created 40m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Add eth0 [10.133.0.87/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Container started 40m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Container created 40m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Add eth0 [10.132.0.88/23] from ovn-kubernetes 40m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Container created 40m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Container started 40m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Add eth0 [10.134.0.72/23] from ovn-kubernetes 40m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Add eth0 [10.134.0.70/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Add eth0 [10.132.0.89/23] from ovn-kubernetes 40m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Container created 40m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Container started 40m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Add eth0 [10.132.0.90/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Container created 40m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Container started 40m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused... 40m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused... 40m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused 40m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused 40m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused... 40m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused 40m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz 40m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled up replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 2 to 3 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 9; reason: 40m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled up replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 8 to 9 40m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Add eth0 [10.132.0.93/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Container started 40m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Container created 40m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 40m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Add eth0 [10.133.0.89/23] from ovn-kubernetes 40m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Container created 40m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Container started 40m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 40m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 40m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused 40m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Readiness probe failed: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 40m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Readiness probe error: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 40m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 40m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 40m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 40m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j 40m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled up replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 3 to 6 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 40m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 40m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Container created 40m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Container started 40m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Container created 40m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Container started 40m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Container started 40m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Add eth0 [10.133.0.92/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Container started 40m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Container created 40m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Add eth0 [10.134.0.74/23] from ovn-kubernetes 40m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Add eth0 [10.132.0.94/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled up replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 3 to 5 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 40m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Container created 40m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts 40m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t 40m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Add eth0 [10.134.0.75/23] from ovn-kubernetes 40m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Add eth0 [10.133.0.93/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Container started 40m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Container created 40m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused... 40m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused 40m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused... 40m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused 40m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl 40m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled up replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 5 to 10 40m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled up replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 7 to 10 40m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled up replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 9 to 10 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 40m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 40m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 40m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm 40m Normal SuccessfulCreate replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 (combined from similar events): Created pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww 40m Normal SuccessfulCreate replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c (combined from similar events): Created pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf 40m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled up replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 6 to 9 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 9; reason: All metrics below target 40m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 40m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 40m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d 40m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n 40m Normal SuccessfulCreate replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 (combined from similar events): Created pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb 40m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl 40m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Add eth0 [10.132.0.100/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Container started 40m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Container created 40m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Container created 40m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Add eth0 [10.133.0.97/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Container started 40m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Container created 40m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Add eth0 [10.134.0.79/23] from ovn-kubernetes 40m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Add eth0 [10.132.0.96/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Add eth0 [10.133.0.96/23] from ovn-kubernetes 40m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Container created 40m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Add eth0 [10.132.0.99/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Container started 40m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Container created 40m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Container started 40m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Container started 40m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Container started 40m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Add eth0 [10.134.0.81/23] from ovn-kubernetes 40m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Add eth0 [10.134.0.77/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Container created 40m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Add eth0 [10.133.0.99/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Add eth0 [10.134.0.78/23] from ovn-kubernetes 40m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Container started 40m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Container started 40m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df (combined from similar events): Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj 40m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 40m Normal AddedInterface pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Add eth0 [10.132.0.97/23] from ovn-kubernetes 40m Normal AddedInterface pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Add eth0 [10.134.0.80/23] from ovn-kubernetes 40m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 40m Normal AddedInterface pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Add eth0 [10.133.0.95/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Add eth0 [10.133.0.98/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Container created 40m Normal Pulled pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled up replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 5 to 10 40m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Container started 40m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Container created 40m Normal Pulled pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Add eth0 [10.132.0.98/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Add eth0 [10.134.0.76/23] from ovn-kubernetes 40m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Add eth0 [10.132.0.95/23] from ovn-kubernetes 40m Normal Created pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Container created 40m Normal Started pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Container started 40m Normal Started pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Container started 40m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s 40m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Container created 40m Normal Created pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Container created 40m Normal SuccessfulCreate replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Created pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb 40m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Container started 40m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Container created 40m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Container started 40m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Container created 40m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Container created 40m Normal Created pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Container created 40m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Container started 40m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Container created 40m Normal Started pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Container started 40m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Container started 40m Normal Created pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Container created 40m Normal Started pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Container started 40m Normal Pulled pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused... 39m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf 39m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl 39m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled up replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 7 to 10 39m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 39m Normal SuccessfulCreate replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf (combined from similar events): Created pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv 39m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Add eth0 [10.133.0.106/23] from ovn-kubernetes 39m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Container created 39m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Container started 39m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Container started 39m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Container created 39m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Container started 39m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Add eth0 [10.134.0.83/23] from ovn-kubernetes 39m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled up replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 5 to 10 39m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 39m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Container started 39m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Container started 39m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Container created 39m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Add eth0 [10.132.0.105/23] from ovn-kubernetes 39m Normal Started pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Container started 39m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Container created 39m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Container created 39m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 39m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Container created 39m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 (combined from similar events): Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 39m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Add eth0 [10.133.0.107/23] from ovn-kubernetes 39m Normal Created pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Container created 39m Normal Pulled pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 39m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Add eth0 [10.133.0.108/23] from ovn-kubernetes 39m Normal AddedInterface pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Add eth0 [10.132.0.104/23] from ovn-kubernetes 39m Normal Pulled pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt 39m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Add eth0 [10.134.0.82/23] from ovn-kubernetes 39m Normal SuccessfulCreate replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Created pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k 39m Normal AddedInterface pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Add eth0 [10.132.0.103/23] from ovn-kubernetes 39m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Container started 39m Normal Created pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Container created 39m Normal Started pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Container started 39m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused 39m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused 39m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused... 39m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Normal AddedLabel gateway/e2e-ait-cbfcf47a Added label istio.io/rev=openshift-gateway to gateway e2e-ait-cbfcf47a 38m Normal SuccessfulCreate replicaset/e2e-ait-cbfcf47a-openshift-default-659f56fb9 Created pod: e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn 38m Normal ScalingReplicaSet deployment/e2e-ait-cbfcf47a-openshift-default Scaled up replica set e2e-ait-cbfcf47a-openshift-default-659f56fb9 from 0 to 1 38m Normal Pulled pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Created pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Container created 38m Normal Started pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Container started 38m Normal AddedInterface pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Add eth0 [10.134.0.86/23] from ovn-kubernetes 38m Warning ProbeError pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused... 38m Warning Unhealthy pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused 38m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Readiness probe failed: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Readiness probe error: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Readiness probe error: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Readiness probe error: Get "http://10.133.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Readiness probe failed: Get "http://10.133.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Readiness probe failed: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Readiness probe failed: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Normal ScalingReplicaSet deployment/e2e-ait-2e17271b-openshift-default Scaled up replica set e2e-ait-2e17271b-openshift-default-57bc7cb65f from 0 to 1 38m Normal AddedLabel gateway/e2e-ait-2e17271b Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2e17271b 38m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Readiness probe error: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Normal SuccessfulCreate replicaset/e2e-ait-2e17271b-openshift-default-57bc7cb65f Created pod: e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr 38m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Readiness probe error: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Readiness probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Readiness probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Readiness probe failed: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Readiness probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Readiness probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Normal AddedInterface pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Add eth0 [10.133.0.120/23] from ovn-kubernetes 38m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Normal Pulled pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Normal Started pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Container started 38m Normal Created pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Container created 38m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-cbfcf47a Scaled up replica set payload-processing-e2e-ait-cbfcf47a-797d9f5d99 from 0 to 1 38m Warning FailedCreate replicaset/payload-processing-e2e-ait-cbfcf47a-797d9f5d99 Error creating: pods "payload-processing-e2e-ait-cbfcf47a-797d9f5d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cbfcf47a: serviceaccount "payload-processing-e2e-ait-cbfcf47a" not found 38m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-cbfcf47a Scaled up replica set payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f from 0 to 1 38m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-cbfcf47a-797d9f5d99 Created pod: payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv 38m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f Created pod: payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp 38m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f Error creating: pods "payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-cbfcf47a: serviceaccount "payload-processing-e2e-ait-cbfcf47a" not found 38m Normal AddedInterface pod/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp Add eth0 [10.134.0.87/23] from ovn-kubernetes 38m Normal Pulled pod/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Created pod/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp Container created 38m Normal Started pod/payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv Container started 38m Normal Pulled pod/payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Started pod/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp Container started 38m Normal AddedInterface pod/payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv Add eth0 [10.133.0.123/23] from ovn-kubernetes 38m Normal Created pod/payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv Container created 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-cbfcf47a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Normal SuccessfulCreate replicaset/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9 Created pod: e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk 38m Normal ScalingReplicaSet deployment/e2e-derive-26c00c22-openshift-default Scaled up replica set e2e-derive-26c00c22-openshift-default-7cdbc5f7d9 from 0 to 1 38m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-2e17271b-67fb547655 Error creating: pods "payload-pre-processing-e2e-ait-2e17271b-67fb547655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2e17271b: serviceaccount "payload-processing-e2e-ait-2e17271b" not found 38m Normal AddedLabel gateway/e2e-derive-26c00c22 Added label istio.io/rev=openshift-gateway to gateway e2e-derive-26c00c22 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-cbfcf47a-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Warning FailedCreate replicaset/payload-processing-e2e-ait-2e17271b-769fd8b889 Error creating: pods "payload-processing-e2e-ait-2e17271b-769fd8b889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2e17271b: serviceaccount "payload-processing-e2e-ait-2e17271b" not found 38m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-2e17271b-67fb547655 Created pod: payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz 38m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-2e17271b Scaled up replica set payload-pre-processing-e2e-ait-2e17271b-67fb547655 from 0 to 1 38m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-2e17271b Scaled up replica set payload-processing-e2e-ait-2e17271b-769fd8b889 from 0 to 1 38m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-2e17271b-769fd8b889 Created pod: payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml 38m Normal AddedInterface pod/payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz Add eth0 [10.133.0.124/23] from ovn-kubernetes 38m Normal Started pod/payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz Container started 38m Normal Created pod/payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml Container created 38m Normal Pulled pod/payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk Add eth0 [10.134.0.88/23] from ovn-kubernetes 38m Normal AddedInterface pod/payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml Add eth0 [10.133.0.125/23] from ovn-kubernetes 38m Normal Pulled pod/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Pulled pod/payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Created pod/payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz Container created 38m Normal Started pod/payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml Container started 38m Normal Started pod/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk Container started 38m Normal Created pod/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk Container created 38m Normal ScalingReplicaSet deployment/payload-processing-e2e-derive-26c00c22 Scaled up replica set payload-processing-e2e-derive-26c00c22-78cf5b6bf5 from 0 to 1 38m Normal SuccessfulCreate replicaset/payload-processing-e2e-derive-26c00c22-78cf5b6bf5 Created pod: payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 38m Warning FailedCreate replicaset/payload-processing-e2e-derive-26c00c22-78cf5b6bf5 Error creating: pods "payload-processing-e2e-derive-26c00c22-78cf5b6bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-26c00c22: serviceaccount "payload-processing-e2e-derive-26c00c22" not found 38m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-derive-26c00c22 Scaled up replica set payload-pre-processing-e2e-derive-26c00c22-8ffd65f95 from 0 to 1 38m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95 Created pod: payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 38m Warning FailedCreate replicaset/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95 Error creating: pods "payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-26c00c22: serviceaccount "payload-processing-e2e-derive-26c00c22" not found 38m Normal Started pod/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 Container started 38m Normal Started pod/payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 Container started 38m Normal Created pod/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 Container created 38m Normal Pulled pod/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Created pod/payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 Container created 38m Normal AddedInterface pod/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 Add eth0 [10.134.0.89/23] from ovn-kubernetes 38m Normal Pulled pod/payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 Add eth0 [10.134.0.90/23] from ovn-kubernetes 38m Normal SuccessfulCreate replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 (combined from similar events): Created pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 38m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 38m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled up replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 9 to 10 38m Normal AddedInterface pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Add eth0 [10.133.0.129/23] from ovn-kubernetes 38m Normal Pulled pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Created pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Container created 38m Normal Started pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Container started 38m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused... 38m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-2e17271b-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-2e17271b-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-crz4q 38m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-9r5ng 38m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 4; reason: cpu resource utilization (percentage of request) above target 38m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 4 38m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Readiness probe error: Get "http://10.133.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-cbfcf47a-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-cbfcf47a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 38m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Container started 38m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Container created 38m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Add eth0 [10.132.0.110/23] from ovn-kubernetes 38m Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 38m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Readiness probe failed: HTTP probe failed with statuscode: 503 38m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Readiness probe error: HTTP probe failed with statuscode: 503... 38m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Add eth0 [10.134.0.91/23] from ovn-kubernetes 38m Normal Killing pod/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp Stopping container payload-pre-processing 38m Normal SuccessfulRescale horizontalpodautoscaler/e2e-ait-2e17271b-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 38m Normal Killing pod/payload-processing-e2e-ait-2e17271b-769fd8b889-gcnml Stopping container payload-processing 38m Normal SuccessfulCreate replicaset/e2e-ait-2e17271b-openshift-default-57bc7cb65f Created pod: e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb 38m Normal ScalingReplicaSet deployment/e2e-ait-2e17271b-openshift-default Scaled up replica set e2e-ait-2e17271b-openshift-default-57bc7cb65f from 1 to 2 38m Normal Killing pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Stopping container istio-proxy 38m Warning ProbeError pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Readiness probe error: HTTP probe failed with statuscode: 503... 38m Warning Unhealthy pod/e2e-ait-cbfcf47a-openshift-default-659f56fb9-dgfvn Readiness probe failed: HTTP probe failed with statuscode: 503 38m Normal AddedInterface pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Add eth0 [10.134.0.92/23] from ovn-kubernetes 38m Normal Killing pod/payload-pre-processing-e2e-ait-2e17271b-67fb547655-8lkcz Stopping container payload-pre-processing 38m Normal Started pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Container started 38m Normal Created pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Container created 38m Normal ScalingReplicaSet deployment/e2e-migrate-c96ee058-gw-openshift-default Scaled up replica set e2e-migrate-c96ee058-gw-openshift-default-d47865b85 from 0 to 1 38m Normal Pulled pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Killing pod/payload-processing-e2e-ait-cbfcf47a-797d9f5d99-j2nzv Stopping container payload-processing 38m Normal AddedLabel gateway/e2e-migrate-c96ee058-gw Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c96ee058-gw 38m Normal SuccessfulCreate replicaset/e2e-migrate-c96ee058-gw-openshift-default-d47865b85 Created pod: e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 38m Normal Pulled pod/e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Created pod/e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 Container created 38m Normal Started pod/e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 Container started 38m Normal AddedInterface pod/e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 Add eth0 [10.133.0.133/23] from ovn-kubernetes 38m Normal Killing pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Stopping container istio-proxy 38m Warning ProbeError pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused... 38m Normal ScalingReplicaSet deployment/e2e-ait-b3a1058c-openshift-default Scaled up replica set e2e-ait-b3a1058c-openshift-default-66948f8c99 from 0 to 1 38m Normal SuccessfulCreate replicaset/e2e-ait-b3a1058c-openshift-default-66948f8c99 Created pod: e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 38m Warning FailedToRetrieveImagePullSecret pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Unable to retrieve some image pull secrets (e2e-ait-2e17271b-openshift-default-dockercfg-pdbqv); attempting to pull the image may not succeed. 38m Normal AddedLabel gateway/e2e-ait-b3a1058c Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b3a1058c 38m Warning Unhealthy pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused 38m Normal AddedInterface pod/e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 Add eth0 [10.133.0.134/23] from ovn-kubernetes 38m Warning FailedCreate replicaset/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc Error creating: pods "payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c96ee058: serviceaccount "payload-processing-e2e-migrate-c96ee058" not found 38m Normal ScalingReplicaSet deployment/payload-processing-e2e-migrate-c96ee058 Scaled up replica set payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc from 0 to 1 38m Normal Pulled pod/e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Warning Unhealthy pod/payload-pre-processing-e2e-ait-cbfcf47a-65cb5b8c5f-7jmsp Readiness probe failed: timeout: failed to connect service "10.134.0.87:50052" within 1s: context deadline exceeded 38m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-migrate-c96ee058 Scaled up replica set payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf from 0 to 1 38m Normal Started pod/e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 Container started 38m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf Created pod: payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm 38m Normal Killing pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-gvnnb Stopping container istio-proxy 38m Warning FailedCreate replicaset/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf Error creating: pods "payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c96ee058: serviceaccount "payload-processing-e2e-migrate-c96ee058" not found 38m Normal Created pod/e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 Container created 38m Normal SuccessfulCreate replicaset/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc Created pod: payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 38m Normal AddedInterface pod/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm Add eth0 [10.133.0.136/23] from ovn-kubernetes 38m Normal Pulled pod/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Pulled pod/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Started pod/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 Container started 38m Normal Created pod/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm Container created 38m Normal AddedInterface pod/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 Add eth0 [10.133.0.135/23] from ovn-kubernetes 38m Normal Created pod/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 Container created 38m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Container started 38m Normal Started pod/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm Container started 38m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Container created 38m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 10.05s (10.05s including waiting). Image size: 185476477 bytes. 37m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5 Error creating: pods "payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b3a1058c: serviceaccount "payload-processing-e2e-ait-b3a1058c" not found 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-derive-26c00c22-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-b3a1058c Scaled up replica set payload-pre-processing-e2e-ait-b3a1058c-7497754ff5 from 0 to 1 37m Normal Killing pod/payload-pre-processing-e2e-derive-26c00c22-8ffd65f95-tcdh4 Stopping container payload-pre-processing 37m Warning Unhealthy pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Readiness probe failed: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 37m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Readiness probe error: HTTP probe failed with statuscode: 503... 37m Warning FailedCreate replicaset/payload-processing-e2e-ait-b3a1058c-654dd64c97 Error creating: pods "payload-processing-e2e-ait-b3a1058c-654dd64c97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b3a1058c: serviceaccount "payload-processing-e2e-ait-b3a1058c" not found 37m Warning ProbeError pod/e2e-ait-2e17271b-openshift-default-57bc7cb65f-56nxr Readiness probe error: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 37m Normal Killing pod/payload-processing-e2e-derive-26c00c22-78cf5b6bf5-gcdw6 Stopping container payload-processing 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-derive-26c00c22-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Readiness probe failed: HTTP probe failed with statuscode: 503 37m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-b3a1058c Scaled up replica set payload-processing-e2e-ait-b3a1058c-654dd64c97 from 0 to 1 37m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-b3a1058c-654dd64c97 Created pod: payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth 37m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5 Created pod: payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn 37m Normal Created pod/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn Container created 37m Normal AddedInterface pod/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn Add eth0 [10.133.0.138/23] from ovn-kubernetes 37m Normal Pulled pod/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal Started pod/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn Container started 37m Normal Started pod/payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth Container started 37m Normal Created pod/payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth Container created 37m Normal Pulled pod/payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal AddedInterface pod/payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth Add eth0 [10.133.0.137/23] from ovn-kubernetes 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-migrate-c96ee058-gw-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-migrate-c96ee058-gw-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Normal Killing pod/e2e-derive-26c00c22-openshift-default-7cdbc5f7d9-42ghk Stopping container istio-proxy 37m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 37m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-migrate-c96ee058-gw-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-migrate-c96ee058-gw-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 37m Normal Killing pod/payload-pre-processing-e2e-migrate-c96ee058-55bc8f8dcf-xzbgm Stopping container payload-pre-processing 37m Normal Killing pod/payload-processing-e2e-migrate-c96ee058-5dfbd4dbbc-dbc76 Stopping container payload-processing 37m Normal SuccessfulCreate replicaset/e2e-shared-a-w4-6eb768-openshift-default-74584fc495 Created pod: e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf 37m Normal ScalingReplicaSet deployment/e2e-shared-a-w4-6eb768-openshift-default Scaled up replica set e2e-shared-a-w4-6eb768-openshift-default-74584fc495 from 0 to 1 37m Normal Killing pod/e2e-migrate-c96ee058-gw-openshift-default-d47865b85-m2kp7 Stopping container istio-proxy 37m Normal AddedLabel gateway/e2e-shared-a-w4-6eb768 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-6eb768 37m Normal AddedInterface pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Add eth0 [10.133.0.141/23] from ovn-kubernetes 37m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w4-6eb768 Scaled up replica set payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985 from 0 to 1 37m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc Created pod: payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq 37m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985 Error creating: pods "payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-6eb768: serviceaccount "payload-processing-e2e-shared-a-w4-6eb768" not found 37m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w4-6eb768 Scaled up replica set payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc from 0 to 1 37m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985 Created pod: payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n 37m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc Error creating: pods "payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-6eb768: serviceaccount "payload-processing-e2e-shared-a-w4-6eb768" not found 37m Normal Created pod/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n Container created 37m Normal Created pod/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq Container created 37m Normal Started pod/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq Container started 37m Normal Started pod/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n Container started 37m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq Add eth0 [10.133.0.142/23] from ovn-kubernetes 37m Normal Pulled pod/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal AddedInterface pod/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n Add eth0 [10.134.0.93/23] from ovn-kubernetes 37m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-b3a1058c-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Normal Killing pod/payload-pre-processing-e2e-ait-b3a1058c-7497754ff5-jpdmn Stopping container payload-pre-processing 37m Normal Killing pod/payload-processing-e2e-ait-b3a1058c-654dd64c97-qqmth Stopping container payload-processing 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-b3a1058c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Normal Killing pod/e2e-ait-b3a1058c-openshift-default-66948f8c99-ng8b5 Stopping container istio-proxy 37m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-fcddeb-openshift-default Scaled up replica set e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f from 0 to 1 37m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Created pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 37m Normal AddedLabel gateway/e2e-shared-a-w1-fcddeb Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-fcddeb 37m Normal AddedInterface pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Add eth0 [10.133.0.144/23] from ovn-kubernetes 37m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w1-fcddeb Scaled up replica set payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459 from 0 to 1 37m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w1-fcddeb Scaled up replica set payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547 from 0 to 1 37m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459 Error creating: pods "payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-fcddeb: serviceaccount "payload-processing-e2e-shared-a-w1-fcddeb" not found 37m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459 Created pod: payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd 37m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547 Error creating: pods "payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-fcddeb: serviceaccount "payload-processing-e2e-shared-a-w1-fcddeb" not found 37m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547 Created pod: payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 37m Normal Pulled pod/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal Created pod/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd Container created 37m Normal Created pod/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 Container created 37m Normal AddedInterface pod/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 Add eth0 [10.133.0.146/23] from ovn-kubernetes 37m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd Add eth0 [10.133.0.145/23] from ovn-kubernetes 37m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal Started pod/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 Container started 37m Normal Started pod/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd Container started 36m Normal ScalingReplicaSet deployment/e2e-shared-b-w4-b9cbea-openshift-default Scaled up replica set e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f from 0 to 1 36m Normal AddedLabel gateway/e2e-shared-b-w4-b9cbea Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-b9cbea 36m Normal SuccessfulCreate replicaset/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f Created pod: e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b 36m Normal AddedInterface pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Add eth0 [10.134.0.94/23] from ovn-kubernetes 36m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w4-b9cbea Scaled up replica set payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc from 0 to 1 36m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc Created pod: payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 36m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w4-b9cbea Scaled up replica set payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf from 0 to 1 36m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf Error creating: pods "payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-b9cbea: serviceaccount "payload-processing-e2e-shared-b-w4-b9cbea" not found 36m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc Error creating: pods "payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-b9cbea: serviceaccount "payload-processing-e2e-shared-b-w4-b9cbea" not found 36m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf Created pod: payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb 36m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal Started pod/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb Container started 36m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb Add eth0 [10.133.0.148/23] from ovn-kubernetes 36m Normal Created pod/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb Container created 36m Normal AddedInterface pod/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 Add eth0 [10.133.0.149/23] from ovn-kubernetes 36m Normal Started pod/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 Container started 36m Normal Created pod/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 Container created 36m Normal Pulled pod/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal AddedLabel gateway/e2e-shared-b-w1-2d78ea Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-2d78ea 36m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf Created pod: e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 36m Normal ScalingReplicaSet deployment/e2e-shared-b-w1-2d78ea-openshift-default Scaled up replica set e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf from 0 to 1 36m Normal AddedInterface pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Add eth0 [10.134.0.95/23] from ovn-kubernetes 36m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w1-2d78ea Scaled up replica set payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7 from 0 to 1 36m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7 Created pod: payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm 36m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7 Error creating: pods "payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-2d78ea: serviceaccount "payload-processing-e2e-shared-b-w1-2d78ea" not found 36m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9 Error creating: pods "payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-2d78ea: serviceaccount "payload-processing-e2e-shared-b-w1-2d78ea" not found 36m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w1-2d78ea Scaled up replica set payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9 from 0 to 1 36m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9 Created pod: payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 36m Normal Created pod/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm Container created 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Normal Created pod/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 Container created 36m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 Add eth0 [10.133.0.152/23] from ovn-kubernetes 36m Normal Started pod/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 Container started 36m Normal AddedInterface pod/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm Add eth0 [10.133.0.151/23] from ovn-kubernetes 36m Normal Pulled pod/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal Started pod/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm Container started 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Normal SuccessfulCreate replicaset/e2e-mt-a536f35b-openshift-default-c4485d7c Created pod: e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 36m Normal ScalingReplicaSet deployment/e2e-mt-a536f35b-openshift-default Scaled up replica set e2e-mt-a536f35b-openshift-default-c4485d7c from 0 to 1 36m Normal AddedLabel gateway/e2e-mt-a536f35b Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a536f35b 36m Normal AddedInterface pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Add eth0 [10.134.0.96/23] from ovn-kubernetes 36m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Created pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx 36m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Created pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd 36m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Created pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn 36m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 36m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-fcddeb-openshift-default Scaled up replica set e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f from 1 to 4 36m Normal Created pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Container created 36m Normal AddedInterface pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Add eth0 [10.133.0.153/23] from ovn-kubernetes 36m Normal Started pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Container started 36m Normal AddedInterface pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Add eth0 [10.134.0.97/23] from ovn-kubernetes 36m Normal Pulled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Created pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Container created 36m Normal Started pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Container started 36m Normal AddedInterface pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Add eth0 [10.132.0.115/23] from ovn-kubernetes 36m Normal Pulled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Created pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Container created 36m Normal Started pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Container started 36m Normal Pulled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-a536f35b Scaled up replica set payload-processing-e2e-mt-a536f35b-f874cf565 from 0 to 1 36m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-a536f35b-6cbd899467 Error creating: pods "payload-pre-processing-e2e-mt-a536f35b-6cbd899467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a536f35b: serviceaccount "payload-processing-e2e-mt-a536f35b" not found 36m Warning ProbeError pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Readiness probe error: Get "http://10.133.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 36m Warning Unhealthy pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Readiness probe failed: Get "http://10.133.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 36m Warning FailedCreate replicaset/payload-processing-e2e-mt-a536f35b-f874cf565 Error creating: pods "payload-processing-e2e-mt-a536f35b-f874cf565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a536f35b: serviceaccount "payload-processing-e2e-mt-a536f35b" not found 36m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-a536f35b-f874cf565 Created pod: payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 36m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-a536f35b Scaled up replica set payload-pre-processing-e2e-mt-a536f35b-6cbd899467 from 0 to 1 36m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-a536f35b-6cbd899467 Created pod: payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr 36m Normal Pulled pod/payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal Created pod/payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr Container created 36m Normal Started pod/payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr Container started 36m Normal AddedInterface pod/payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 Add eth0 [10.133.0.155/23] from ovn-kubernetes 36m Normal Pulled pod/payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal Created pod/payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 Container created 36m Normal Started pod/payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 Container started 36m Normal AddedInterface pod/payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr Add eth0 [10.133.0.154/23] from ovn-kubernetes 36m Warning Unhealthy pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Readiness probe failed: Get "http://10.133.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 36m Warning ProbeError pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Readiness probe error: Get "http://10.133.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 36m Normal Created pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Container created 36m Normal Created pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Container created 36m Normal Pulled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Pulled pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Started pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Container started 36m Normal Started pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Container started 36m Warning ProbeError pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused... 36m Warning Unhealthy pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused 36m Warning ProbeError pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused... 36m Warning Unhealthy pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused 36m Warning Unhealthy pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Startup probe failed: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused 36m Warning ProbeError pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Startup probe error: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused... 36m Warning ProbeError pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused... 36m Warning Unhealthy pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused 36m Warning Unhealthy pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused 36m Warning ProbeError pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused... 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w4-6eb768-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w4-6eb768-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 35m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 35m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Created pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp 35m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-fcddeb-openshift-default Scaled up replica set e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f from 4 to 5 35m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default New size: 5; reason: 35m Normal Started pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Container started 35m Normal Created pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Container created 35m Normal Pulled pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Add eth0 [10.134.0.99/23] from ovn-kubernetes 35m Normal ScalingReplicaSet deployment/e2e-api-a-3c7998-openshift-default Scaled up replica set e2e-api-a-3c7998-openshift-default-cf99794c5 from 0 to 1 35m Warning Unhealthy pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Readiness probe failed: Get "http://10.134.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 35m Normal AddedLabel gateway/e2e-api-a-3c7998 Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-3c7998 35m Warning ProbeError pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Readiness probe error: Get "http://10.134.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 35m Normal SuccessfulCreate replicaset/e2e-api-a-3c7998-openshift-default-cf99794c5 Created pod: e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 35m Normal AddedInterface pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Add eth0 [10.134.0.100/23] from ovn-kubernetes 35m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-3c7998 Scaled up replica set payload-processing-e2e-api-a-3c7998-67bfcdf9b9 from 0 to 1 35m Warning ProbeError pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused... 35m Warning Unhealthy pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused 35m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-3c7998 Scaled up replica set payload-pre-processing-e2e-api-a-3c7998-6d4ff44995 from 0 to 1 35m Warning FailedCreate replicaset/payload-processing-e2e-api-a-3c7998-67bfcdf9b9 Error creating: pods "payload-processing-e2e-api-a-3c7998-67bfcdf9b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3c7998: serviceaccount "payload-processing-e2e-api-a-3c7998" not found 35m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-3c7998-67bfcdf9b9 Created pod: payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m 35m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995 Created pod: payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq 35m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995 Error creating: pods "payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3c7998: serviceaccount "payload-processing-e2e-api-a-3c7998" not found 35m Normal Created pod/payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m Container created 35m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq Add eth0 [10.133.0.161/23] from ovn-kubernetes 35m Normal Started pod/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq Container started 35m Normal Created pod/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq Container created 35m Normal Pulled pod/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m Add eth0 [10.133.0.162/23] from ovn-kubernetes 35m Normal Started pod/payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m Container started 35m Normal Pulled pod/payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal Started pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Container started 35m Normal Created pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Container created 35m Normal Pulled pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Normal Created pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Container created 35m Normal Started pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Container started 35m Normal Pulled pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Warning ProbeError pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused... 35m Warning Unhealthy pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused 35m Warning Unhealthy pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused 35m Warning ProbeError pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused... 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w1-2d78ea-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w1-2d78ea-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-3c7998-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-3c7998-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Normal SuccessfulCreate replicaset/e2e-api-b-82b108-openshift-default-d596c9f89 Created pod: e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw 35m Normal ScalingReplicaSet deployment/e2e-api-b-82b108-openshift-default Scaled up replica set e2e-api-b-82b108-openshift-default-d596c9f89 from 0 to 1 35m Normal AddedLabel gateway/e2e-api-b-82b108 Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-82b108 35m Normal AddedInterface pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Add eth0 [10.133.0.164/23] from ovn-kubernetes 35m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 35m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 35m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 35m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 35m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 35m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w1-2d78ea-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Normal ScalingReplicaSet deployment/e2e-shared-a-w2-fa9526-openshift-default Scaled up replica set e2e-shared-a-w2-fa9526-openshift-default-677bd569b5 from 0 to 1 35m Normal SuccessfulCreate replicaset/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5 Created pod: e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm 35m Normal AddedLabel gateway/e2e-shared-a-w2-fa9526 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-fa9526 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w1-2d78ea-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Normal AddedLabel gateway/e2e-mt-2b73c810 Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2b73c810 35m Normal SuccessfulCreate replicaset/e2e-mt-2b73c810-openshift-default-68d568696f Created pod: e2e-mt-2b73c810-openshift-default-68d568696f-twzgb 35m Normal ScalingReplicaSet deployment/e2e-mt-2b73c810-openshift-default Scaled up replica set e2e-mt-2b73c810-openshift-default-68d568696f from 0 to 1 35m Normal AddedInterface pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Add eth0 [10.134.0.101/23] from ovn-kubernetes 35m Normal AddedInterface pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Add eth0 [10.133.0.165/23] from ovn-kubernetes 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w4-b9cbea-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w4-b9cbea-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-82b108 Scaled up replica set payload-pre-processing-e2e-api-b-82b108-77f564d699 from 0 to 1 35m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-82b108-79d7b7dddc Created pod: payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 35m Warning FailedCreate replicaset/payload-processing-e2e-api-b-82b108-79d7b7dddc Error creating: pods "payload-processing-e2e-api-b-82b108-79d7b7dddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-82b108: serviceaccount "payload-processing-e2e-api-b-82b108" not found 35m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-82b108 Scaled up replica set payload-processing-e2e-api-b-82b108-79d7b7dddc from 0 to 1 35m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-82b108-77f564d699 Error creating: pods "payload-pre-processing-e2e-api-b-82b108-77f564d699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-82b108: serviceaccount "payload-processing-e2e-api-b-82b108" not found 35m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-82b108-77f564d699 Created pod: payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh 35m Normal Started pod/payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh Container started 35m Normal Created pod/payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 Container created 35m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779 Error creating: pods "payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fa9526: serviceaccount "payload-processing-e2e-shared-a-w2-fa9526" not found 35m Normal AddedInterface pod/payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 Add eth0 [10.132.0.119/23] from ovn-kubernetes 35m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779 Created pod: payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 35m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w2-fa9526 Scaled up replica set payload-processing-e2e-shared-a-w2-fa9526-55fcd67459 from 0 to 1 35m Normal Created pod/payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh Container created 35m Normal Started pod/payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 Container started 35m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459 Error creating: pods "payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fa9526: serviceaccount "payload-processing-e2e-shared-a-w2-fa9526" not found 35m Normal Pulled pod/payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459 Created pod: payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 35m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w2-fa9526 Scaled up replica set payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779 from 0 to 1 35m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh Add eth0 [10.132.0.118/23] from ovn-kubernetes 35m Normal Pulled pod/payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-2b73c810-798bdd757f Created pod: payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr 35m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-2b73c810 Scaled up replica set payload-pre-processing-e2e-mt-2b73c810-577674b7ff from 0 to 1 35m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 Add eth0 [10.132.0.120/23] from ovn-kubernetes 35m Warning FailedCreate replicaset/payload-processing-e2e-mt-2b73c810-798bdd757f Error creating: pods "payload-processing-e2e-mt-2b73c810-798bdd757f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2b73c810: serviceaccount "payload-processing-e2e-mt-2b73c810" not found 35m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-2b73c810 Scaled up replica set payload-processing-e2e-mt-2b73c810-798bdd757f from 0 to 1 35m Normal Started pod/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 Container started 35m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-2b73c810-577674b7ff Error creating: pods "payload-pre-processing-e2e-mt-2b73c810-577674b7ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2b73c810: serviceaccount "payload-processing-e2e-mt-2b73c810" not found 35m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 Add eth0 [10.132.0.121/23] from ovn-kubernetes 35m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-2b73c810-577674b7ff Created pod: payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg 35m Normal Created pod/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 Container created 35m Normal Started pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Container started 35m Normal Created pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Container created 35m Normal Started pod/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 Container started 35m Normal Created pod/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 Container created 35m Normal Pulled pod/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal Pulled pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Normal Started pod/payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr Container started 35m Normal Created pod/payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr Container created 35m Normal Pulled pod/payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr Add eth0 [10.132.0.122/23] from ovn-kubernetes 35m Normal Started pod/payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg Container started 35m Normal Pulled pod/payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal Created pod/payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg Container created 35m Normal AddedInterface pod/payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg Add eth0 [10.133.0.166/23] from ovn-kubernetes 35m Warning ProbeError pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused... 35m Warning Unhealthy pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-2b73c810-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-2b73c810-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Normal ScalingReplicaSet deployment/e2e-shared-b-w2-10572d-openshift-default Scaled up replica set e2e-shared-b-w2-10572d-openshift-default-54488cd6dc from 0 to 1 34m Normal AddedLabel gateway/e2e-shared-b-w2-10572d Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-10572d 34m Normal SuccessfulCreate replicaset/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc Created pod: e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 34m Normal AddedInterface pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Add eth0 [10.133.0.168/23] from ovn-kubernetes 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-3c7998-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-3c7998-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767 Created pod: payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 34m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767 Error creating: pods "payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-10572d: serviceaccount "payload-processing-e2e-shared-b-w2-10572d" not found 34m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df Error creating: pods "payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-10572d: serviceaccount "payload-processing-e2e-shared-b-w2-10572d" not found 34m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w2-10572d Scaled up replica set payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df from 0 to 1 34m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w2-10572d Scaled up replica set payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767 from 0 to 1 34m Normal Created pod/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 Container created 34m Normal Started pod/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 Container started 34m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 34m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df Created pod: payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c 34m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 Add eth0 [10.132.0.126/23] from ovn-kubernetes 34m Normal Started pod/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c Container started 34m Normal Created pod/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c Container created 34m Normal Pulled pod/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c Add eth0 [10.132.0.127/23] from ovn-kubernetes 34m Normal Killing pod/payload-pre-processing-e2e-api-a-3c7998-6d4ff44995-p7pfq Stopping container payload-pre-processing 34m Normal Killing pod/payload-processing-e2e-api-a-3c7998-67bfcdf9b9-dfj8m Stopping container payload-processing 34m Warning ProbeError pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Readiness probe error: Get "http://10.134.0.101:15021/healthz/ready": read tcp 10.134.0.2:35014->10.134.0.101:15021: read: connection reset by peer... 34m Normal Pulled pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Warning ProbeError pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Readiness probe error: Get "http://10.133.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 34m Warning Unhealthy pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Readiness probe failed: Get "http://10.133.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 34m Warning Unhealthy pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Readiness probe failed: Get "http://10.134.0.101:15021/healthz/ready": read tcp 10.134.0.2:35014->10.134.0.101:15021: read: connection reset by peer 34m Normal Started pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Container started 34m Normal Created pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Container created 34m Normal Created pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Container created 34m Normal Pulled pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Pulled pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Started pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Container started 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-82b108-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-82b108-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Normal Started pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Container started 34m Normal Created pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Container created 34m Warning ProbeError pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w2-fa9526-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning ProbeError pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused 34m Warning ProbeError pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w2-fa9526-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Normal AddedLabel gateway/e2e-api-a-9f84de Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9f84de 34m Normal ScalingReplicaSet deployment/e2e-api-a-9f84de-openshift-default Scaled up replica set e2e-api-a-9f84de-openshift-default-6954b8b997 from 0 to 1 34m Normal SuccessfulCreate replicaset/e2e-api-a-9f84de-openshift-default-6954b8b997 Created pod: e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 34m Normal AddedInterface pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Add eth0 [10.134.0.103/23] from ovn-kubernetes 33m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-2b73c810-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 33m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-9f84de Scaled up replica set payload-processing-e2e-api-a-9f84de-867b56cbc5 from 0 to 1 33m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-9f84de Scaled up replica set payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5 from 0 to 1 33m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-9f84de-867b56cbc5 Created pod: payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd 33m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5 Error creating: pods "payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9f84de: serviceaccount "payload-processing-e2e-api-a-9f84de" not found 33m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5 Created pod: payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 33m Warning FailedCreate replicaset/payload-processing-e2e-api-a-9f84de-867b56cbc5 Error creating: pods "payload-processing-e2e-api-a-9f84de-867b56cbc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9f84de: serviceaccount "payload-processing-e2e-api-a-9f84de" not found 33m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-2b73c810-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 33m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 Add eth0 [10.132.0.129/23] from ovn-kubernetes 33m Normal Pulled pod/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 33m Normal Created pod/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 Container created 33m Normal AddedInterface pod/payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd Add eth0 [10.132.0.130/23] from ovn-kubernetes 33m Normal Pulled pod/payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 33m Normal Created pod/payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd Container created 33m Normal Started pod/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 Container started 33m Normal Started pod/payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd Container started 33m Normal Killing pod/e2e-api-a-3c7998-openshift-default-cf99794c5-44cv9 Stopping container istio-proxy 33m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-82b108-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 33m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-82b108-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 33m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr Stopping container istio-proxy 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 9; reason: All metrics below target 33m Normal SuccessfulDelete replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Deleted pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-69msr 33m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled down replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 10 to 9 33m Normal Killing pod/payload-pre-processing-e2e-mt-a536f35b-6cbd899467-lxcrr Stopping container payload-pre-processing 33m Normal Killing pod/payload-processing-e2e-mt-a536f35b-f874cf565-xkfb8 Stopping container payload-processing 33m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w2-fa9526-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 33m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w2-fa9526-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 33m Normal Started pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Container started 33m Normal Created pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Container created 33m Normal Pulled pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 33m Normal Killing pod/payload-pre-processing-e2e-api-b-82b108-77f564d699-qnmjh Stopping container payload-pre-processing 33m Normal Killing pod/payload-processing-e2e-api-b-82b108-79d7b7dddc-wzqv7 Stopping container payload-processing 33m Warning ProbeError pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused... 33m Warning Unhealthy pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused 33m Normal Pulled pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 33m Normal Created pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Container created 33m Normal Started pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Container started 33m Normal SuccessfulDelete replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Deleted pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 33m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Stopping container istio-proxy 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 8; reason: All metrics below target 33m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled down replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 9 to 8 33m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-8zhk2 Readiness probe error: HTTP probe failed with statuscode: 503... 33m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-a536f35b-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 33m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-a536f35b-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 33m Warning Unhealthy pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused 33m Warning ProbeError pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused... 33m Normal AddedLabel gateway/e2e-api-b-a9cd5e Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a9cd5e 33m Normal ScalingReplicaSet deployment/e2e-api-b-a9cd5e-openshift-default Scaled up replica set e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc from 0 to 1 33m Normal SuccessfulCreate replicaset/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc Created pod: e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb 33m Normal AddedInterface pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Add eth0 [10.133.0.170/23] from ovn-kubernetes 33m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-a9cd5e Scaled up replica set payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55 from 0 to 1 33m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled down replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 10 to 9 33m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled down replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 10 to 9 33m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Stopping container istio-proxy 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 9; reason: All metrics below target 33m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc Created pod: payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 33m Normal SuccessfulDelete replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Deleted pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf 33m Normal SuccessfulDelete replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Deleted pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm 33m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-7ttwf Stopping container istio-proxy 33m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55 Created pod: payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 9; reason: All metrics below target 33m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55 Error creating: pods "payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a9cd5e: serviceaccount "payload-processing-e2e-api-b-a9cd5e" not found 33m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-a9cd5e Scaled up replica set payload-processing-e2e-api-b-a9cd5e-58c95dbbdc from 0 to 1 33m Warning FailedCreate replicaset/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc Error creating: pods "payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a9cd5e: serviceaccount "payload-processing-e2e-api-b-a9cd5e" not found 33m Normal Pulled pod/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 33m Normal Created pod/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 Container created 33m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 Add eth0 [10.132.0.135/23] from ovn-kubernetes 33m Normal Pulled pod/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 33m Normal Started pod/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 Container started 33m Normal AddedInterface pod/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 Add eth0 [10.132.0.136/23] from ovn-kubernetes 33m Normal Created pod/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 Container created 33m Normal Started pod/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 Container started 33m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-hr4wm Readiness probe error: HTTP probe failed with statuscode: 503... 33m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w2-10572d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 33m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w2-10572d-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 33m Normal Killing pod/e2e-api-b-82b108-openshift-default-d596c9f89-9p7pw Stopping container istio-proxy 33m Normal AddedLabel gateway/e2e-inf-a-bdb694 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-bdb694 33m Normal SuccessfulCreate replicaset/e2e-inf-a-bdb694-openshift-default-5698cb5d69 Created pod: e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv 33m Normal ScalingReplicaSet deployment/e2e-inf-a-bdb694-openshift-default Scaled up replica set e2e-inf-a-bdb694-openshift-default-5698cb5d69 from 0 to 1 33m Normal AddedInterface pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Add eth0 [10.134.0.104/23] from ovn-kubernetes 33m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Stopping container istio-proxy 33m Normal SuccessfulCreate replicaset/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87 Created pod: e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 33m Normal AddedLabel gateway/e2e-shared-a-w3-9f3188 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-9f3188 33m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled down replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 9 to 7 33m Normal SuccessfulDelete replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Deleted pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 7; reason: All metrics below target 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 7; reason: All metrics below target 33m Normal SuccessfulDelete replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Deleted pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj 33m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Stopping container istio-proxy 33m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-5rllj Stopping container istio-proxy 33m Normal SuccessfulDelete replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Deleted pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb 33m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled down replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 8 to 7 33m Normal ScalingReplicaSet deployment/e2e-shared-a-w3-9f3188-openshift-default Scaled up replica set e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87 from 0 to 1 33m Normal AddedInterface pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Add eth0 [10.134.0.105/23] from ovn-kubernetes 33m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Readiness probe error: HTTP probe failed with statuscode: 503... 33m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-g8cxb Readiness probe failed: HTTP probe failed with statuscode: 503 33m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-zlfkt Readiness probe error: HTTP probe failed with statuscode: 503... 32m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-bdb694-7f64dd85b7 Error creating: pods "payload-processing-e2e-inf-a-bdb694-7f64dd85b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bdb694: serviceaccount "payload-processing-e2e-inf-a-bdb694" not found 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-bdb694 Scaled up replica set payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f from 0 to 1 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f Error creating: pods "payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bdb694: serviceaccount "payload-processing-e2e-inf-a-bdb694" not found 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f Created pod: payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-bdb694-7f64dd85b7 Created pod: payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-bdb694 Scaled up replica set payload-processing-e2e-inf-a-bdb694-7f64dd85b7 from 0 to 1 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w3-9f3188 Scaled up replica set payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c from 0 to 1 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c Error creating: pods "payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9f3188: serviceaccount "payload-processing-e2e-shared-a-w3-9f3188" not found 32m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Add eth0 [10.133.0.171/23] from ovn-kubernetes 32m Normal Pulled pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal Pulled pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c Created pod: payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r 32m Normal AddedInterface pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Add eth0 [10.133.0.172/23] from ovn-kubernetes 32m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w3-9f3188-6575d78977 Error creating: pods "payload-processing-e2e-shared-a-w3-9f3188-6575d78977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9f3188: serviceaccount "payload-processing-e2e-shared-a-w3-9f3188" not found 32m Normal Created pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Container created 32m Normal Started pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Container started 32m Normal Created pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Container created 32m Normal Started pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Container started 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w3-9f3188 Scaled up replica set payload-processing-e2e-shared-a-w3-9f3188-6575d78977 from 0 to 1 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w3-9f3188-6575d78977 Created pod: payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq 32m Normal Killing pod/payload-processing-e2e-mt-2b73c810-798bdd757f-8k9lr Stopping container payload-processing 32m Normal Killing pod/payload-pre-processing-e2e-mt-2b73c810-577674b7ff-5jxgg Stopping container payload-pre-processing 32m Normal Created pod/payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq Container created 32m Normal Pulled pod/payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal Started pod/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r Container started 32m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r Add eth0 [10.133.0.173/23] from ovn-kubernetes 32m Normal Created pod/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r Container created 32m Normal AddedInterface pod/payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq Add eth0 [10.133.0.174/23] from ovn-kubernetes 32m Normal Started pod/payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq Container started 32m Normal AddedLabel gateway/e2e-inf-a-ffe132 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ffe132 32m Normal ScalingReplicaSet deployment/e2e-inf-a-ffe132-openshift-default Scaled up replica set e2e-inf-a-ffe132-openshift-default-c4d7b6ddf from 0 to 1 32m Normal SuccessfulCreate replicaset/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf Created pod: e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr 32m Normal AddedInterface pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Add eth0 [10.133.0.175/23] from ovn-kubernetes 32m Normal SuccessfulDelete replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Deleted pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt 32m Normal SuccessfulDelete replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Deleted pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 32m Normal SuccessfulDelete replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Deleted pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t 32m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6cwn5 Stopping container istio-proxy 32m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default Scaled down replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 9 to 7 32m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl Stopping container istio-proxy 32m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 Stopping container istio-proxy 32m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 Stopping container istio-proxy 32m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled down replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 10 to 8 32m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wptxt Stopping container istio-proxy 32m Normal SuccessfulDelete replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Deleted pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-tnbdl 32m Normal SuccessfulDelete replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Deleted pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 32m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-hd78t Stopping container istio-proxy 32m Normal SuccessfulDelete replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Deleted pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kgk94 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 8; reason: All metrics below target 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 7; reason: All metrics below target 32m Normal SuccessfulDelete replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Deleted pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-x7t86 32m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-wf6b6 Stopping container istio-proxy 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 7; reason: All metrics below target 32m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled down replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 10 to 7 32m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Stopping container istio-proxy 32m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled down replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 10 to 7 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 7; reason: All metrics below target 32m Normal SuccessfulDelete replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Deleted pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk 32m Normal SuccessfulDelete replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Deleted pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 32m Normal SuccessfulDelete replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Deleted pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s 32m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-qwvqk Stopping container istio-proxy 32m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Stopping container istio-proxy 32m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-ffe132-d646f478c Error creating: pods "payload-processing-e2e-inf-a-ffe132-d646f478c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ffe132: serviceaccount "payload-processing-e2e-inf-a-ffe132" not found 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-ffe132 Scaled up replica set payload-processing-e2e-inf-a-ffe132-d646f478c from 0 to 1 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-ffe132-d646f478c Created pod: payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c Error creating: pods "payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ffe132: serviceaccount "payload-processing-e2e-inf-a-ffe132" not found 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c Created pod: payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-ffe132 Scaled up replica set payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c from 0 to 1 32m Normal Pulled pod/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp Add eth0 [10.133.0.177/23] from ovn-kubernetes 32m Normal AddedInterface pod/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp Add eth0 [10.133.0.176/23] from ovn-kubernetes 32m Normal Created pod/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp Container created 32m Normal Started pod/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp Container started 32m Normal Pulled pod/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal Started pod/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp Container started 32m Normal Created pod/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp Container created 32m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-a536f35b-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 32m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-a536f35b-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 32m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-hpw5s Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused... 32m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-zkz79 Readiness probe error: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 32m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-ffe132-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 32m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-ffe132-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 32m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled down replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 8 to 7 32m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Stopping container istio-proxy 32m Normal SuccessfulDelete replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Deleted pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 7; reason: All metrics below target 32m Normal Killing pod/payload-pre-processing-e2e-api-a-9f84de-678d8f9dc5-588n8 Stopping container payload-pre-processing 32m Normal Killing pod/payload-processing-e2e-api-a-9f84de-867b56cbc5-5qmtd Stopping container payload-processing 32m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-t729n Readiness probe error: HTTP probe failed with statuscode: 503... 32m Normal Killing pod/e2e-mt-2b73c810-openshift-default-68d568696f-twzgb Stopping container istio-proxy 32m Normal ScalingReplicaSet deployment/e2e-api-a-0c8eec-openshift-default Scaled up replica set e2e-api-a-0c8eec-openshift-default-7ccb89bb4f from 0 to 1 32m Normal AddedLabel gateway/e2e-api-a-0c8eec Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-0c8eec 32m Normal SuccessfulCreate replicaset/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f Created pod: e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 32m Normal AddedInterface pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Add eth0 [10.133.0.181/23] from ovn-kubernetes 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f Created pod: payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5 Error creating: pods "payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0c8eec: serviceaccount "payload-processing-e2e-api-a-0c8eec" not found 32m Warning FailedCreate replicaset/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f Error creating: pods "payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0c8eec: serviceaccount "payload-processing-e2e-api-a-0c8eec" not found 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-0c8eec Scaled up replica set payload-processing-e2e-api-a-0c8eec-56cf9b4c9f from 0 to 1 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-0c8eec Scaled up replica set payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5 from 0 to 1 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5 Created pod: payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 32m Normal Started pod/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt Container started 32m Normal Pulled pod/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal Created pod/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 Container created 32m Normal Killing pod/e2e-mt-a536f35b-openshift-default-c4485d7c-lvbd2 Stopping container istio-proxy 32m Normal AddedInterface pod/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt Add eth0 [10.133.0.182/23] from ovn-kubernetes 32m Normal Started pod/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 Container started 32m Normal Created pod/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt Container created 32m Normal Pulled pod/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 Add eth0 [10.133.0.183/23] from ovn-kubernetes 32m Normal AddedLabel gateway/e2e-inf-b-332694 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-332694 32m Normal SuccessfulCreate replicaset/e2e-inf-b-332694-openshift-default-5c5687c879 Created pod: e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g 32m Normal ScalingReplicaSet deployment/e2e-inf-b-332694-openshift-default Scaled up replica set e2e-inf-b-332694-openshift-default-5c5687c879 from 0 to 1 32m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-9f84de-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 32m Normal SuccessfulCreate replicaset/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc Created pod: e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm 32m Normal Created pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Container created 32m Normal Started pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Container started 32m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-9f84de-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 32m Normal ScalingReplicaSet deployment/e2e-shared-b-w3-32a584-openshift-default Scaled up replica set e2e-shared-b-w3-32a584-openshift-default-b4b9965cc from 0 to 1 32m Normal AddedInterface pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Add eth0 [10.134.0.106/23] from ovn-kubernetes 32m Normal Pulled pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 32m Normal AddedLabel gateway/e2e-shared-b-w3-32a584 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-32a584 32m Normal AddedInterface pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Add eth0 [10.134.0.107/23] from ovn-kubernetes 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff Created pod: payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-332694 Scaled up replica set payload-processing-e2e-inf-b-332694-56f87fc569 from 0 to 1 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-332694-56f87fc569 Created pod: payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr 32m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-332694-56f87fc569 Error creating: pods "payload-processing-e2e-inf-b-332694-56f87fc569-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-332694: serviceaccount "payload-processing-e2e-inf-b-332694" not found 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-332694 Scaled up replica set payload-pre-processing-e2e-inf-b-332694-67bfcd58ff from 0 to 1 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff Error creating: pods "payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-332694: serviceaccount "payload-processing-e2e-inf-b-332694" not found 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87 Created pod: payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk 32m Normal Started pod/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr Container started 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87 Error creating: pods "payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-32a584: serviceaccount "payload-processing-e2e-shared-b-w3-32a584" not found 32m Normal AddedInterface pod/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr Add eth0 [10.133.0.185/23] from ovn-kubernetes 32m Normal Pulled pod/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal Created pod/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr Container created 32m Normal Started pod/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd Container started 32m Normal Created pod/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd Container created 32m Normal Pulled pod/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd Add eth0 [10.133.0.184/23] from ovn-kubernetes 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w3-32a584 Scaled up replica set payload-processing-e2e-shared-b-w3-32a584-665d8875f9 from 0 to 1 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w3-32a584-665d8875f9 Created pod: payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb 32m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w3-32a584-665d8875f9 Error creating: pods "payload-processing-e2e-shared-b-w3-32a584-665d8875f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-32a584: serviceaccount "payload-processing-e2e-shared-b-w3-32a584" not found 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w3-32a584 Scaled up replica set payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87 from 0 to 1 32m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk Add eth0 [10.133.0.186/23] from ovn-kubernetes 32m Warning Unhealthy pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused 32m Warning ProbeError pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused... 32m Normal Pulled pod/payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb Add eth0 [10.133.0.187/23] from ovn-kubernetes 32m Normal Created pod/payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb Container created 32m Normal Created pod/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk Container created 32m Normal Started pod/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk Container started 32m Normal Started pod/payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb Container started 32m Normal AddedLabel gateway/e2e-inf-b-a99fad Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a99fad 32m Normal ScalingReplicaSet deployment/e2e-inf-b-a99fad-openshift-default Scaled up replica set e2e-inf-b-a99fad-openshift-default-8475f7788f from 0 to 1 32m Normal SuccessfulCreate replicaset/e2e-inf-b-a99fad-openshift-default-8475f7788f Created pod: e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 32m Normal AddedInterface pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Add eth0 [10.134.0.108/23] from ovn-kubernetes 32m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled down replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 10 to 8 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 8; reason: All metrics below target 32m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 Stopping container istio-proxy 32m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-9f84de-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 32m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-9f84de-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 32m Normal SuccessfulDelete replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Deleted pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv 32m Normal SuccessfulDelete replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Deleted pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-66t95 32m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-877bv Stopping container istio-proxy 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc Error creating: pods "payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a99fad: serviceaccount "payload-processing-e2e-inf-b-a99fad" not found 32m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-a99fad-58ff94c9ff Error creating: pods "payload-processing-e2e-inf-b-a99fad-58ff94c9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a99fad: serviceaccount "payload-processing-e2e-inf-b-a99fad" not found 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-a99fad-58ff94c9ff Created pod: payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-a99fad Scaled up replica set payload-processing-e2e-inf-b-a99fad-58ff94c9ff from 0 to 1 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc Created pod: payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-a99fad Scaled up replica set payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc from 0 to 1 32m Normal Created pod/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj Container created 32m Normal AddedInterface pod/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj Add eth0 [10.133.0.188/23] from ovn-kubernetes 32m Normal Pulled pod/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal Started pod/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj Container started 31m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 Add eth0 [10.133.0.189/23] from ovn-kubernetes 31m Normal Pulled pod/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 31m Normal Created pod/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 Container created 31m Normal Started pod/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 Container started 31m Normal Pulled pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Created pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Container created 31m Normal Started pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Container started 31m Normal Started pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Container started 31m Normal Created pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Container created 31m Normal Pulled pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-bdb694-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-bdb694-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Normal Killing pod/e2e-api-a-9f84de-openshift-default-6954b8b997-qkj46 Stopping container istio-proxy 31m Warning ProbeError pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused... 31m Warning Unhealthy pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused 31m Warning ProbeError pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused... 31m Warning Unhealthy pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused 31m Normal AddedLabel gateway/e2e-api-b-0d0987 Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0d0987 31m Normal SuccessfulCreate replicaset/e2e-api-b-0d0987-openshift-default-7bb6d56c95 Created pod: e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 31m Normal ScalingReplicaSet deployment/e2e-api-b-0d0987-openshift-default Scaled up replica set e2e-api-b-0d0987-openshift-default-7bb6d56c95 from 0 to 1 31m Normal AddedInterface pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Add eth0 [10.134.0.111/23] from ovn-kubernetes 31m Normal Killing pod/payload-pre-processing-e2e-api-b-a9cd5e-69bb85bc55-zv8d9 Stopping container payload-pre-processing 31m Normal Killing pod/payload-processing-e2e-api-b-a9cd5e-58c95dbbdc-7pnq6 Stopping container payload-processing 31m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-0d0987 Scaled up replica set payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5 from 0 to 1 31m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-0d0987 Scaled up replica set payload-processing-e2e-api-b-0d0987-9ffc79b6f from 0 to 1 31m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5 Created pod: payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f 31m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5 Error creating: pods "payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0d0987: serviceaccount "payload-processing-e2e-api-b-0d0987" not found 31m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-0d0987-9ffc79b6f Created pod: payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb 31m Warning FailedCreate replicaset/payload-processing-e2e-api-b-0d0987-9ffc79b6f Error creating: pods "payload-processing-e2e-api-b-0d0987-9ffc79b6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0d0987: serviceaccount "payload-processing-e2e-api-b-0d0987" not found 31m Normal Started pod/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f Container started 31m Normal Pulled pod/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f Add eth0 [10.133.0.191/23] from ovn-kubernetes 31m Normal AddedInterface pod/payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb Add eth0 [10.133.0.192/23] from ovn-kubernetes 31m Normal Created pod/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f Container created 31m Normal Started pod/payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb Container started 31m Normal Pulled pod/payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 31m Normal Created pod/payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb Container created 31m Normal AddedLabel gateway/e2e-inf-a-225668 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-225668 31m Normal AddedInterface pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Add eth0 [10.134.0.112/23] from ovn-kubernetes 31m Normal ScalingReplicaSet deployment/e2e-inf-a-225668-openshift-default Scaled up replica set e2e-inf-a-225668-openshift-default-765b499d89 from 0 to 1 31m Normal SuccessfulCreate replicaset/e2e-inf-a-225668-openshift-default-765b499d89 Created pod: e2e-inf-a-225668-openshift-default-765b499d89-wnbmm 31m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-fcddeb-openshift-default Scaled down replica set e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f from 5 to 4 31m Normal SuccessfulDelete replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Deleted pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default New size: 4; reason: All metrics below target 31m Normal Killing pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-cktrp Stopping container istio-proxy 31m Normal Pulled pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Created pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Container created 31m Normal Started pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Container started 31m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-a9cd5e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-a9cd5e-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc Error creating: pods "payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-225668: serviceaccount "payload-processing-e2e-inf-a-225668" not found 31m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-225668-65675d6655 Created pod: payload-processing-e2e-inf-a-225668-65675d6655-qdr5l 31m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-ffe132-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc Created pod: payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm 31m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-225668 Scaled up replica set payload-processing-e2e-inf-a-225668-65675d6655 from 0 to 1 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-ffe132-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-225668 Scaled up replica set payload-pre-processing-e2e-inf-a-225668-6d7866c8dc from 0 to 1 31m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-225668-65675d6655 Error creating: pods "payload-processing-e2e-inf-a-225668-65675d6655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-225668: serviceaccount "payload-processing-e2e-inf-a-225668" not found 31m Normal Pulled pod/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l Add eth0 [10.132.0.142/23] from ovn-kubernetes 31m Normal Started pod/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm Container started 31m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm Add eth0 [10.132.0.143/23] from ovn-kubernetes 31m Normal Created pod/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm Container created 31m Normal Pulled pod/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 31m Normal Started pod/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l Container started 31m Normal Created pod/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l Container created 31m Warning ProbeError pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused... 31m Warning Unhealthy pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-a9cd5e-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 31m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-a9cd5e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-bdb694-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 31m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-bdb694-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 31m Normal SuccessfulCreate replicaset/e2e-inf-b-332694-openshift-default-5c5687c879 Created pod: e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm 31m Normal Pulled pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal ScalingReplicaSet deployment/e2e-inf-b-332694-openshift-default Scaled up replica set e2e-inf-b-332694-openshift-default-5c5687c879 from 1 to 4 31m Normal Created pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Container created 31m Normal Created pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Container created 31m Normal Pulled pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Started pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Container started 31m Normal SuccessfulCreate replicaset/e2e-inf-b-332694-openshift-default-5c5687c879 Created pod: e2e-inf-b-332694-openshift-default-5c5687c879-x4frm 31m Normal SuccessfulCreate replicaset/e2e-inf-b-332694-openshift-default-5c5687c879 Created pod: e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-332694-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 31m Normal Started pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Container started 31m Normal Created pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Container created 31m Normal Started pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Container started 31m Normal Created pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Container created 31m Normal Started pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Container started 31m Normal Created pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Container created 31m Normal Pulled pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Pulled pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Add eth0 [10.132.0.145/23] from ovn-kubernetes 31m Normal AddedInterface pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Add eth0 [10.134.0.113/23] from ovn-kubernetes 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w3-32a584-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Normal Started pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Container started 31m Normal Created pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Container created 31m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w3-32a584-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 31m Normal Pulled pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Started pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Container started 31m Normal Pulled pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Add eth0 [10.133.0.196/23] from ovn-kubernetes 30m Normal Killing pod/e2e-api-b-a9cd5e-openshift-default-7c6b7fc5fc-zchpb Stopping container istio-proxy 30m Normal AddedLabel gateway/e2e-inf-a-11c1a8 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-11c1a8 30m Warning ProbeError pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused 30m Warning ProbeError pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused 30m Normal ScalingReplicaSet deployment/e2e-inf-a-11c1a8-openshift-default Scaled up replica set e2e-inf-a-11c1a8-openshift-default-6f96865fb5 from 0 to 1 30m Warning Unhealthy pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Startup probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused 30m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp 30m Warning ProbeError pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Startup probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused 30m Warning ProbeError pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused 30m Warning ProbeError pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused 30m Warning ProbeError pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused... 30m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Add eth0 [10.134.0.114/23] from ovn-kubernetes 30m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-11c1a8-598fbd7d99 Error creating: pods "payload-processing-e2e-inf-a-11c1a8-598fbd7d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-11c1a8: serviceaccount "payload-processing-e2e-inf-a-11c1a8" not found 30m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9 Error creating: pods "payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-11c1a8: serviceaccount "payload-processing-e2e-inf-a-11c1a8" not found 30m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9 Created pod: payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk 30m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-11c1a8 Scaled up replica set payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9 from 0 to 1 30m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-11c1a8 Scaled up replica set payload-processing-e2e-inf-a-11c1a8-598fbd7d99 from 0 to 1 30m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-11c1a8-598fbd7d99 Created pod: payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn 30m Normal Created pod/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn Container created 30m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk Add eth0 [10.134.0.115/23] from ovn-kubernetes 30m Normal AddedInterface pod/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn Add eth0 [10.132.0.147/23] from ovn-kubernetes 30m Normal Pulled pod/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal Started pod/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn Container started 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-332694-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 30m Normal Pulled pod/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal Created pod/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk Container created 30m Normal Started pod/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk Container started 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-332694-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-0c8eec-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-0c8eec-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-332694-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-332694-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Normal Killing pod/payload-processing-e2e-api-a-0c8eec-56cf9b4c9f-pw4gt Stopping container payload-processing 30m Normal Killing pod/payload-pre-processing-e2e-api-a-0c8eec-5d6fcc5bf5-xtjr8 Stopping container payload-pre-processing 30m Normal SuccessfulCreate replicaset/e2e-inf-b-79c47f-openshift-default-556b6749b5 Created pod: e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj 30m Normal AddedLabel gateway/e2e-inf-b-79c47f Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-79c47f 30m Normal ScalingReplicaSet deployment/e2e-inf-b-79c47f-openshift-default Scaled up replica set e2e-inf-b-79c47f-openshift-default-556b6749b5 from 0 to 1 30m Normal AddedInterface pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Add eth0 [10.133.0.199/23] from ovn-kubernetes 30m Normal AddedLabel gateway/e2e-inf-a-7a62d4 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7a62d4 30m Normal SuccessfulCreate replicaset/e2e-inf-a-7a62d4-openshift-default-745855d459 Created pod: e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 30m Normal ScalingReplicaSet deployment/e2e-inf-a-7a62d4-openshift-default Scaled up replica set e2e-inf-a-7a62d4-openshift-default-745855d459 from 0 to 1 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-0c8eec-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-0c8eec-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Normal AddedInterface pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Add eth0 [10.134.0.116/23] from ovn-kubernetes 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-11c1a8-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-11c1a8-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-79c47f Scaled up replica set payload-processing-e2e-inf-b-79c47f-746754fdd7 from 0 to 1 30m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475 Error creating: pods "payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-79c47f: serviceaccount "payload-processing-e2e-inf-b-79c47f" not found 30m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475 Created pod: payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg 30m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-79c47f Scaled up replica set payload-pre-processing-e2e-inf-b-79c47f-b44bd7475 from 0 to 1 30m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-79c47f-746754fdd7 Error creating: pods "payload-processing-e2e-inf-b-79c47f-746754fdd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-79c47f: serviceaccount "payload-processing-e2e-inf-b-79c47f" not found 30m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-79c47f-746754fdd7 Created pod: payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws 30m Normal Created pod/payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws Container created 30m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg Add eth0 [10.133.0.201/23] from ovn-kubernetes 30m Normal Pulled pod/payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal Started pod/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg Container started 30m Normal AddedInterface pod/payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws Add eth0 [10.133.0.200/23] from ovn-kubernetes 30m Normal Created pod/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg Container created 30m Normal Pulled pod/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal Started pod/payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws Container started 30m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc Error creating: pods "payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7a62d4: serviceaccount "payload-processing-e2e-inf-a-7a62d4" not found 30m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-7a62d4 Scaled up replica set payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc from 0 to 1 30m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-7a62d4 Scaled up replica set payload-processing-e2e-inf-a-7a62d4-89cbcddfc from 0 to 1 30m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc Created pod: payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb 30m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-7a62d4-89cbcddfc Error creating: pods "payload-processing-e2e-inf-a-7a62d4-89cbcddfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7a62d4: serviceaccount "payload-processing-e2e-inf-a-7a62d4" not found 30m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-7a62d4-89cbcddfc Created pod: payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 30m Normal Pulled pod/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 Add eth0 [10.133.0.203/23] from ovn-kubernetes 30m Normal Pulled pod/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb Add eth0 [10.133.0.202/23] from ovn-kubernetes 30m Normal Started pod/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 Container started 30m Normal Created pod/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb Container created 30m Normal Created pod/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 Container created 30m Normal Started pod/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb Container started 30m Normal SuccessfulCreate replicaset/e2e-inf-b-332694-openshift-default-5c5687c879 Created pod: e2e-inf-b-332694-openshift-default-5c5687c879-hs829 30m Normal SuccessfulCreate replicaset/e2e-inf-b-332694-openshift-default-5c5687c879 Created pod: e2e-inf-b-332694-openshift-default-5c5687c879-wztdr 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-332694-openshift-default New size: 7; reason: All metrics below target 30m Normal ScalingReplicaSet deployment/e2e-inf-b-332694-openshift-default Scaled up replica set e2e-inf-b-332694-openshift-default-5c5687c879 from 4 to 7 30m Normal SuccessfulCreate replicaset/e2e-inf-b-332694-openshift-default-5c5687c879 Created pod: e2e-inf-b-332694-openshift-default-5c5687c879-546fr 30m Normal AddedInterface pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Add eth0 [10.133.0.204/23] from ovn-kubernetes 30m Normal Pulled pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal Created pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Container created 30m Normal Started pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Container started 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w3-32a584-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w3-32a584-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 30m Normal Created pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Container created 30m Normal Started pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Container started 30m Normal AddedInterface pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Add eth0 [10.132.0.149/23] from ovn-kubernetes 30m Normal Pulled pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Warning Unhealthy pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Readiness probe failed: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 30m Normal Pulled pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal Created pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Container created 30m Normal Started pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Container started 30m Warning ProbeError pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Readiness probe error: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 30m Normal AddedInterface pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Add eth0 [10.134.0.117/23] from ovn-kubernetes 30m Normal SuccessfulCreate replicaset/e2e-inf-a-225668-openshift-default-765b499d89 Created pod: e2e-inf-a-225668-openshift-default-765b499d89-2mjrh 30m Warning Unhealthy pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-225668-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 30m Warning Unhealthy pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused 30m Normal AddedInterface pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Add eth0 [10.133.0.206/23] from ovn-kubernetes 30m Warning ProbeError pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused... 30m Warning ProbeError pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused... 30m Normal Started pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Container started 30m Normal Created pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Container created 30m Normal Pulled pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal ScalingReplicaSet deployment/e2e-inf-a-225668-openshift-default Scaled up replica set e2e-inf-a-225668-openshift-default-765b499d89 from 1 to 2 30m Warning Unhealthy pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Startup probe failed: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused 30m Warning ProbeError pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Startup probe error: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Readiness probe failed: Get "http://10.134.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 30m Warning ProbeError pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Readiness probe error: Get "http://10.134.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 30m Normal AddedLabel gateway/e2e-inf-a-3cee6a Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-3cee6a 30m Normal SuccessfulCreate replicaset/e2e-inf-a-3cee6a-openshift-default-854f54449c Created pod: e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl 30m Normal ScalingReplicaSet deployment/e2e-inf-a-3cee6a-openshift-default Scaled up replica set e2e-inf-a-3cee6a-openshift-default-854f54449c from 0 to 1 30m Normal Pulled pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal Started pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Container started 30m Normal Created pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Container created 30m Normal Pulled pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal Started pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Container started 30m Normal Created pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Container created 30m Normal Pulled pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal Started pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Container started 30m Normal Created pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Container created 30m Normal AddedInterface pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Add eth0 [10.134.0.118/23] from ovn-kubernetes 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-a99fad-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-a99fad-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Warning ProbeError pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Startup probe error: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Startup probe failed: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused 30m Normal Started pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Container started 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-bdb694-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 30m Normal SuccessfulCreate replicaset/e2e-inf-a-bdb694-openshift-default-5698cb5d69 Created pod: e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj 30m Normal Pulled pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal Created pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Container created 30m Normal ScalingReplicaSet deployment/e2e-inf-a-bdb694-openshift-default Scaled up replica set e2e-inf-a-bdb694-openshift-default-5698cb5d69 from 1 to 2 30m Normal AddedInterface pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Add eth0 [10.133.0.207/23] from ovn-kubernetes 30m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c Created pod: payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf 30m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-3cee6a-799d7c674c Error creating: pods "payload-processing-e2e-inf-a-3cee6a-799d7c674c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3cee6a: serviceaccount "payload-processing-e2e-inf-a-3cee6a" not found 30m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-3cee6a Scaled up replica set payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c from 0 to 1 30m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-3cee6a-799d7c674c Created pod: payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk 30m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-3cee6a Scaled up replica set payload-processing-e2e-inf-a-3cee6a-799d7c674c from 0 to 1 30m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c Error creating: pods "payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3cee6a: serviceaccount "payload-processing-e2e-inf-a-3cee6a" not found 30m Normal AddedInterface pod/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk Add eth0 [10.132.0.151/23] from ovn-kubernetes 30m Normal Started pod/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk Container started 30m Normal Created pod/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf Container created 30m Normal Pulled pod/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal AddedLabel gateway/e2e-inf-b-f58171 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f58171 30m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf Add eth0 [10.132.0.150/23] from ovn-kubernetes 30m Normal Started pod/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf Container started 30m Normal Created pod/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk Container created 30m Normal Pulled pod/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal SuccessfulCreate replicaset/e2e-inf-b-f58171-openshift-default-77bc76bfb5 Created pod: e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm 29m Normal ScalingReplicaSet deployment/e2e-inf-b-f58171-openshift-default Scaled up replica set e2e-inf-b-f58171-openshift-default-77bc76bfb5 from 0 to 1 29m Warning ProbeError pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Startup probe error: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused... 29m Warning Unhealthy pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused 29m Warning Unhealthy pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused 29m Warning ProbeError pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused... 29m Warning ProbeError pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused... 29m Warning Unhealthy pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused 29m Warning ProbeError pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused... 29m Warning Unhealthy pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Startup probe failed: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused 29m Normal AddedInterface pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Add eth0 [10.134.0.119/23] from ovn-kubernetes 29m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-f58171 Scaled up replica set payload-processing-e2e-inf-b-f58171-5cc4d546dc from 0 to 1 29m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c Created pod: payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 29m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-f58171 Scaled up replica set payload-pre-processing-e2e-inf-b-f58171-57c45cc64c from 0 to 1 29m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c Error creating: pods "payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f58171: serviceaccount "payload-processing-e2e-inf-b-f58171" not found 29m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-f58171-5cc4d546dc Error creating: pods "payload-processing-e2e-inf-b-f58171-5cc4d546dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f58171: serviceaccount "payload-processing-e2e-inf-b-f58171" not found 29m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-f58171-5cc4d546dc Created pod: payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z 29m Normal Started pod/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z Container started 29m Normal Started pod/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 Container started 29m Normal Created pod/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 Container created 29m Normal Pulled pod/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal Created pod/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z Container created 29m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 Add eth0 [10.132.0.153/23] from ovn-kubernetes 29m Normal Pulled pod/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z Add eth0 [10.134.0.120/23] from ovn-kubernetes 29m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-225668-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-225668-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-0d0987-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-0d0987-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-a99fad-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-a99fad-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Normal Killing pod/e2e-api-a-0c8eec-openshift-default-7ccb89bb4f-tfcl4 Stopping container istio-proxy 29m Normal AddedLabel gateway/e2e-inf-b-d12868 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d12868 29m Normal SuccessfulCreate replicaset/e2e-inf-b-d12868-openshift-default-7f4d86c65f Created pod: e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 29m Normal ScalingReplicaSet deployment/e2e-inf-b-d12868-openshift-default Scaled up replica set e2e-inf-b-d12868-openshift-default-7f4d86c65f from 0 to 1 29m Normal Killing pod/payload-processing-e2e-api-b-0d0987-9ffc79b6f-8hwjb Stopping container payload-processing 29m Normal Killing pod/payload-pre-processing-e2e-api-b-0d0987-bd5c6ddf5-lxm9f Stopping container payload-pre-processing 29m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq Stopping container istio-proxy 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default New size: 6; reason: All metrics below target 29m Normal SuccessfulDelete replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Deleted pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-qfvzq 29m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k Stopping container istio-proxy 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 6; reason: All metrics below target 29m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled down replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 7 to 6 29m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default Scaled down replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 7 to 6 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 6; reason: All metrics below target 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 6; reason: All metrics below target 29m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default Scaled down replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 7 to 6 29m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf Stopping container istio-proxy 29m Normal SuccessfulDelete replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Deleted pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-2fwrf 29m Normal SuccessfulDelete replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Deleted pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 29m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-kfw22 Stopping container istio-proxy 29m Normal SuccessfulDelete replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Deleted pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-fgh2k 29m Normal AddedInterface pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Add eth0 [10.133.0.211/23] from ovn-kubernetes 29m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-d12868 Scaled up replica set payload-pre-processing-e2e-inf-b-d12868-598cd4d97f from 0 to 1 29m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f Created pod: payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx 29m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f Error creating: pods "payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d12868: serviceaccount "payload-processing-e2e-inf-b-d12868" not found 29m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-d12868 Scaled up replica set payload-processing-e2e-inf-b-d12868-7bf6f9d95c from 0 to 1 29m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-d12868-7bf6f9d95c Error creating: pods "payload-processing-e2e-inf-b-d12868-7bf6f9d95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d12868: serviceaccount "payload-processing-e2e-inf-b-d12868" not found 29m Normal Pulled pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-d12868-7bf6f9d95c Created pod: payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm 29m Normal Pulled pod/payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal Started pod/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx Container started 29m Normal Created pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Container created 29m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx Add eth0 [10.134.0.122/23] from ovn-kubernetes 29m Normal Pulled pod/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal Created pod/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx Container created 29m Normal Started pod/payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm Container started 29m Normal Created pod/payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm Container created 29m Normal Started pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Container started 29m Normal AddedInterface pod/payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm Add eth0 [10.134.0.123/23] from ovn-kubernetes 29m Warning Unhealthy pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused 29m Warning ProbeError pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused... 29m Normal AddedLabel gateway/e2e-inf-b-c18bea Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c18bea 29m Normal ScalingReplicaSet deployment/e2e-inf-b-c18bea-openshift-default Scaled up replica set e2e-inf-b-c18bea-openshift-default-5f44c48cbf from 0 to 1 29m Normal SuccessfulCreate replicaset/e2e-inf-b-c18bea-openshift-default-5f44c48cbf Created pod: e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl 29m Normal AddedInterface pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Add eth0 [10.134.0.124/23] from ovn-kubernetes 28m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-7a62d4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-7a62d4-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-c18bea-7957fddcf9 Error creating: pods "payload-processing-e2e-inf-b-c18bea-7957fddcf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c18bea: serviceaccount "payload-processing-e2e-inf-b-c18bea" not found 28m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-c18bea Scaled up replica set payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75 from 0 to 1 28m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-c18bea-7957fddcf9 Created pod: payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn 28m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75 Error creating: pods "payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c18bea: serviceaccount "payload-processing-e2e-inf-b-c18bea" not found 28m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-c18bea Scaled up replica set payload-processing-e2e-inf-b-c18bea-7957fddcf9 from 0 to 1 28m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75 Created pod: payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs 28m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Add eth0 [10.134.0.126/23] from ovn-kubernetes 28m Normal AddedInterface pod/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn Add eth0 [10.134.0.125/23] from ovn-kubernetes 28m Normal Pulled pod/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 28m Normal Pulled pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 28m Normal Created pod/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn Container created 28m Normal Started pod/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn Container started 28m Normal Started pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Container started 28m Normal Created pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Container created 28m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Stopping container istio-proxy 28m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled down replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 7 to 6 28m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled down replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 7 to 6 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 6; reason: All metrics below target 28m Normal SuccessfulDelete replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Deleted pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 28m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-2k4f4 Stopping container istio-proxy 28m Normal SuccessfulDelete replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Deleted pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 6; reason: All metrics below target 28m Normal Killing pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Stopping container istio-proxy 28m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Readiness probe failed: HTTP probe failed with statuscode: 503 28m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-25trl Readiness probe error: HTTP probe failed with statuscode: 503... 28m Normal ScalingReplicaSet deployment/e2e-inf-a-2747a4-openshift-default Scaled up replica set e2e-inf-a-2747a4-openshift-default-89d775bdf from 0 to 1 28m Normal AddedLabel gateway/e2e-inf-a-2747a4 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2747a4 28m Normal SuccessfulCreate replicaset/e2e-inf-a-2747a4-openshift-default-89d775bdf Created pod: e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x 28m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-7a62d4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 28m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-7a62d4-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 28m Warning ProbeError pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Readiness probe error: HTTP probe failed with statuscode: 503... 28m Normal AddedInterface pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Add eth0 [10.134.0.128/23] from ovn-kubernetes 28m Warning Unhealthy pod/e2e-api-b-0d0987-openshift-default-7bb6d56c95-4d2c7 Readiness probe failed: HTTP probe failed with statuscode: 503 28m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9 Error creating: pods "payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2747a4: serviceaccount "payload-processing-e2e-inf-a-2747a4" not found 28m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-2747a4-67946747c9 Error creating: pods "payload-processing-e2e-inf-a-2747a4-67946747c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2747a4: serviceaccount "payload-processing-e2e-inf-a-2747a4" not found 28m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9 Created pod: payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx 28m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-2747a4 Scaled up replica set payload-pre-processing-e2e-inf-a-2747a4-647847c6c9 from 0 to 1 28m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-2747a4 Scaled up replica set payload-processing-e2e-inf-a-2747a4-67946747c9 from 0 to 1 28m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-2747a4-67946747c9 Created pod: payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl 28m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx Add eth0 [10.132.0.159/23] from ovn-kubernetes 28m Normal AddedInterface pod/payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl Add eth0 [10.132.0.160/23] from ovn-kubernetes 28m Normal Created pod/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx Container created 28m Normal Pulled pod/payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 28m Normal Created pod/payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl Container created 28m Normal Started pod/payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl Container started 28m Normal Pulled pod/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 28m Normal Started pod/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx Container started 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-225668-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 28m Normal SuccessfulCreate replicaset/e2e-inf-a-225668-openshift-default-765b499d89 Created pod: e2e-inf-a-225668-openshift-default-765b499d89-qjf5s 28m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 28m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l 28m Normal ScalingReplicaSet deployment/e2e-inf-a-11c1a8-openshift-default Scaled up replica set e2e-inf-a-11c1a8-openshift-default-6f96865fb5 from 1 to 4 28m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m 28m Normal ScalingReplicaSet deployment/e2e-inf-a-225668-openshift-default Scaled up replica set e2e-inf-a-225668-openshift-default-765b499d89 from 2 to 3 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-11c1a8-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 28m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Add eth0 [10.134.0.130/23] from ovn-kubernetes 28m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Container started 28m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Container created 28m Warning Unhealthy pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Readiness probe failed: Get "http://10.134.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 28m Warning ProbeError pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Readiness probe error: Get "http://10.134.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 28m Normal Pulled pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Created pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Container created 28m Normal Started pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Container started 28m Normal Pulled pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Readiness probe error: Get "http://10.134.0.114:15021/healthz/ready": read tcp 10.134.0.2:59788->10.134.0.114:15021: read: connection reset by peer... 28m Normal Created pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Container created 28m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Container started 28m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Readiness probe failed: Get "http://10.134.0.114:15021/healthz/ready": read tcp 10.134.0.2:59788->10.134.0.114:15021: read: connection reset by peer 28m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Container started 28m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Container created 28m Normal SuccessfulCreate replicaset/e2e-inf-a-bdb694-openshift-default-5698cb5d69 Created pod: e2e-inf-a-bdb694-openshift-default-5698cb5d69-7ssb8 28m Normal ScalingReplicaSet deployment/e2e-inf-a-bdb694-openshift-default Scaled up replica set e2e-inf-a-bdb694-openshift-default-5698cb5d69 from 2 to 3 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-bdb694-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 28m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Startup probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused 28m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Startup probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused... 28m Warning ProbeError pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused 28m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-79c47f-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-79c47f-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 27m Warning ProbeError pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Startup probe error: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused... 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-f58171-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-f58171-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 27m Warning Unhealthy pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Startup probe failed: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused 27m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Startup probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused... 27m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Startup probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused 27m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-ffe132-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 27m Normal ScalingReplicaSet deployment/e2e-inf-a-ffe132-openshift-default Scaled up replica set e2e-inf-a-ffe132-openshift-default-c4d7b6ddf from 1 to 2 27m Normal SuccessfulCreate replicaset/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf Created pod: e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-11c1a8-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-11c1a8-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-f58171-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-f58171-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Normal ScalingReplicaSet deployment/e2e-inf-a-11c1a8-openshift-default Scaled up replica set e2e-inf-a-11c1a8-openshift-default-6f96865fb5 from 4 to 7 27m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx 27m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp 27m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq 27m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-11c1a8-openshift-default New size: 7; reason: All metrics below target 27m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-fcddeb-openshift-default Scaled down replica set e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f from 4 to 3 27m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default New size: 3; reason: All metrics below target 27m Normal SuccessfulDelete replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Deleted pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 27m Normal Killing pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-5z9l9 Stopping container istio-proxy 27m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Add eth0 [10.133.0.214/23] from ovn-kubernetes 27m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Container started 27m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Container created 27m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-79c47f-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-79c47f-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Startup probe failed: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused 27m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Startup probe error: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused... 27m Warning ProbeError pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Readiness probe error: Get "http://10.134.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 27m Warning Unhealthy pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Readiness probe failed: Get "http://10.134.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 27m Normal SuccessfulDelete replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Deleted pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 27m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 7; reason: All metrics below target 27m Normal Created pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Container created 27m Normal SuccessfulDelete replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Deleted pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp 27m Normal Started pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Container started 27m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-g9pzp Stopping container istio-proxy 27m Normal Pulled pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 27m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default New size: 5; reason: All metrics below target 27m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default Scaled down replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 8 to 7 27m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Stopping container istio-proxy 26m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Readiness probe error: HTTP probe failed with statuscode: 503... 26m Normal Created pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Container created 26m Normal Pulled pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Normal Started pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Container started 26m Normal Created pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Container created 26m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-pf7m9 Readiness probe failed: HTTP probe failed with statuscode: 503 26m Normal Created pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Container created 26m Normal Started pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Container started 26m Normal Pulled pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Normal Started pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Container started 26m Normal Pulled pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Warning Unhealthy pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Startup probe failed: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused 26m Warning ProbeError pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Startup probe error: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused... 26m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Container created 26m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Add eth0 [10.133.0.215/23] from ovn-kubernetes 26m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Container started 26m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-d12868-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 26m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-d12868-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 26m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-3cee6a-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 26m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-3cee6a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 26m Normal Pulled pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Warning Unhealthy pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused 26m Warning ProbeError pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused... 26m Warning ProbeError pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused... 26m Warning ProbeError pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused... 26m Normal AddedInterface pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Add eth0 [10.134.0.132/23] from ovn-kubernetes 26m Warning Unhealthy pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused 26m Warning Unhealthy pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused 26m Normal Created pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Container created 26m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Startup probe error: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused... 26m Normal Started pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Container started 26m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Startup probe failed: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused 26m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-2747a4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-2747a4-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-7a62d4-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 26m Normal SuccessfulCreate replicaset/e2e-inf-b-f58171-openshift-default-77bc76bfb5 Created pod: e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d 26m Warning ProbeError pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused... 26m Warning Unhealthy pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused 26m Normal ScalingReplicaSet deployment/e2e-inf-b-f58171-openshift-default Scaled up replica set e2e-inf-b-f58171-openshift-default-77bc76bfb5 from 1 to 2 26m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-f58171-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 26m Normal ScalingReplicaSet deployment/e2e-inf-a-7a62d4-openshift-default Scaled up replica set e2e-inf-a-7a62d4-openshift-default-745855d459 from 1 to 2 26m Normal SuccessfulCreate replicaset/e2e-inf-a-7a62d4-openshift-default-745855d459 Created pod: e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh 26m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-d12868-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-d12868-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-c18bea-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-2747a4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 26m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-2747a4-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 26m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-c18bea-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-3cee6a-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-3cee6a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 25m Normal ScalingReplicaSet deployment/e2e-inf-b-a99fad-openshift-default Scaled up replica set e2e-inf-b-a99fad-openshift-default-8475f7788f from 1 to 2 25m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-a99fad-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 25m Normal SuccessfulCreate replicaset/e2e-inf-b-a99fad-openshift-default-8475f7788f Created pod: e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb 25m Normal SuccessfulDelete replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Deleted pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 25m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled down replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 6 to 5 25m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-fqxh6 Stopping container istio-proxy 25m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 5; reason: All metrics below target 24m Normal Started pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Container started 24m Normal Pulled pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 24m Normal Created pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Container created 24m Normal AddedInterface pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Add eth0 [10.132.0.172/23] from ovn-kubernetes 24m Warning ProbeError pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused... 24m Warning Unhealthy pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused 24m Normal Killing pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Stopping container payload-pre-processing 24m Normal Created pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Container created 24m Normal Pulled pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 24m Normal AddedInterface pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Add eth0 [10.132.0.173/23] from ovn-kubernetes 24m Normal Started pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Container started 24m Normal Killing pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Stopping container istio-proxy 24m Warning Unhealthy pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Startup probe failed: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused 24m Normal Killing pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-rfjmv Stopping container istio-proxy 24m Warning ProbeError pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Startup probe error: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused... 24m Warning Unhealthy pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Warning ProbeError pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Readiness probe error: HTTP probe failed with statuscode: 503... 24m Warning Unhealthy pod/e2e-inf-a-bdb694-openshift-default-5698cb5d69-mkqrj Readiness probe failed: HTTP probe failed with statuscode: 503 24m Normal Started pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Container started 24m Normal Created pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Container created 24m Normal Pulled pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 24m Normal AddedInterface pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Add eth0 [10.133.0.224/23] from ovn-kubernetes 24m Normal Killing pod/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd Stopping container payload-pre-processing 24m Warning Unhealthy pod/payload-processing-e2e-inf-a-bdb694-7f64dd85b7-4d7fk Readiness probe failed: timeout: failed to connect service "10.133.0.172:50052" within 1s: context deadline exceeded 24m Warning Unhealthy pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Startup probe failed: Get "http://10.133.0.224:15021/healthz/ready": dial tcp 10.133.0.224:15021: connect: connection refused 24m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-bdb694-6c4ff8cb5f-qs6ds Readiness probe failed: timeout: failed to connect service "10.133.0.171:50052" within 1s: context deadline exceeded 24m Warning ProbeError pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Startup probe error: Get "http://10.133.0.224:15021/healthz/ready": dial tcp 10.133.0.224:15021: connect: connection refused... 24m Normal AddedInterface pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Add eth0 [10.133.0.225/23] from ovn-kubernetes 24m Normal Started pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Container started 24m Normal Created pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Container created 24m Normal Pulled pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 24m Warning Unhealthy pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused 24m Warning ProbeError pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused... 24m Normal SuccessfulDelete replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Deleted pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 5; reason: All metrics below target 24m Normal SuccessfulDelete replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Deleted pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d 24m Normal SuccessfulDelete replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Deleted pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb 24m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Stopping container istio-proxy 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 5; reason: All metrics below target 24m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-c4rth Stopping container istio-proxy 24m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default Scaled down replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 6 to 5 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default New size: 5; reason: All metrics below target 24m Normal SuccessfulDelete replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Deleted pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf 24m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled down replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 6 to 5 24m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-8h8mf Stopping container istio-proxy 24m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-z76xb Stopping container istio-proxy 24m Warning Unhealthy pod/payload-processing-e2e-inf-b-332694-56f87fc569-q5qgr Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-332694-67bfcd58ff-nqdcd Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Normal Killing pod/payload-processing-e2e-inf-a-2747a4-67946747c9-4smgl Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-inf-a-2747a4-647847c6c9-njbpx Stopping container payload-pre-processing 23m Warning Unhealthy pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-h4b5d Readiness probe error: HTTP probe failed with statuscode: 503... 23m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Add eth0 [10.134.0.147/23] from ovn-kubernetes 23m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Container created 23m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Container started 23m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 23m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Container started 23m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 10 to 9 23m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 23m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 9; reason: All metrics below target 23m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Add eth0 [10.132.0.178/23] from ovn-kubernetes 23m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Add eth0 [10.134.0.148/23] from ovn-kubernetes 23m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-5db77fbd9f Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-g74zd 23m Normal Killing pod/maas-default-gateway-openshift-default-5db77fbd9f-g74zd Stopping container istio-proxy 23m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Container created 23m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Container created 23m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Container started 23m Normal Killing pod/e2e-inf-b-332694-openshift-default-5c5687c879-wztdr Stopping container istio-proxy 23m Normal Killing pod/e2e-inf-b-332694-openshift-default-5c5687c879-vn9nm Stopping container istio-proxy 23m Normal Killing pod/e2e-inf-b-332694-openshift-default-5c5687c879-546fr Stopping container istio-proxy 23m Normal Killing pod/e2e-inf-b-332694-openshift-default-5c5687c879-x4frm Stopping container istio-proxy 23m Normal Killing pod/e2e-inf-b-332694-openshift-default-5c5687c879-8qrgz Stopping container istio-proxy 23m Normal Killing pod/e2e-inf-b-332694-openshift-default-5c5687c879-hs829 Stopping container istio-proxy 23m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-3ff278-openshift-default Scaled up replica set e2e-shared-a-w0-3ff278-openshift-default-7477ff4559 from 0 to 1 23m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559 Created pod: e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp 23m Normal Killing pod/e2e-inf-b-332694-openshift-default-5c5687c879-wsl7g Stopping container istio-proxy 23m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused 23m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused... 23m Normal AddedLabel gateway/e2e-shared-a-w0-3ff278 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-3ff278 23m Normal Killing pod/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp Stopping container payload-processing 23m Normal AddedInterface pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Add eth0 [10.134.0.149/23] from ovn-kubernetes 23m Normal Killing pod/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp Stopping container payload-pre-processing 23m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Startup probe error: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused... 23m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Startup probe failed: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused 23m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused 23m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused... 23m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w0-3ff278 Scaled up replica set payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c from 0 to 1 23m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w0-3ff278 Scaled up replica set payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc from 0 to 1 23m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc Error creating: pods "payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3ff278: serviceaccount "payload-processing-e2e-shared-a-w0-3ff278" not found 23m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c Error creating: pods "payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3ff278: serviceaccount "payload-processing-e2e-shared-a-w0-3ff278" not found 23m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc Created pod: payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h 23m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c Created pod: payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd 23m Normal Created pod/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h Container created 23m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd Add eth0 [10.133.0.227/23] from ovn-kubernetes 23m Normal Started pod/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd Container started 23m Normal Created pod/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd Container created 23m Normal Started pod/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h Container started 23m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 23m Normal Pulled pod/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h Add eth0 [10.133.0.228/23] from ovn-kubernetes 23m Normal Killing pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Stopping container istio-proxy 23m Warning Unhealthy pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-inf-a-2747a4-openshift-default-89d775bdf-j8d6x Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-ffe132-c9cbc6c4c-br8pp Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Warning Unhealthy pod/payload-processing-e2e-inf-a-ffe132-d646f478c-9zxxp Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Normal Killing pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Stopping container payload-pre-processing 23m Normal Killing pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Stopping container payload-processing 23m Normal Killing pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-rvblr Stopping container istio-proxy 23m Normal Killing pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Stopping container istio-proxy 23m Warning Unhealthy pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-inf-a-ffe132-openshift-default-c4d7b6ddf-4mcc4 Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w0-3ff278-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 23m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w0-3ff278-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 23m Normal Killing pod/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 Stopping container payload-pre-processing 23m Normal Killing pod/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj Stopping container payload-processing 23m Normal Killing pod/maas-default-gateway-openshift-default-5db77fbd9f-rl9tr Stopping container istio-proxy 23m Normal Killing pod/maas-default-gateway-openshift-default-5db77fbd9f-76cxc Stopping container istio-proxy 23m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 6; reason: All metrics below target 23m Normal Killing pod/maas-default-gateway-openshift-default-5db77fbd9f-57ktj Stopping container istio-proxy 23m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-5db77fbd9f Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-76cxc 23m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-5db77fbd9f from 9 to 6 23m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-5db77fbd9f Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-57ktj 23m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-5db77fbd9f Deleted pod: maas-default-gateway-openshift-default-5db77fbd9f-rl9tr 23m Normal SuccessfulDelete replicaset/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f Deleted pod: e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn 23m Normal Killing pod/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm Stopping container payload-pre-processing 23m Normal Killing pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nssxn Stopping container istio-proxy 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-fcddeb-openshift-default New size: 2; reason: All metrics below target 23m Normal Killing pod/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l Stopping container payload-processing 23m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-fcddeb-openshift-default Scaled down replica set e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f from 3 to 2 23m Warning Unhealthy pod/payload-processing-e2e-worker-w6-102379-5c958cc4ff-t94ls Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w6-102379-64bd4947ff-7qsss Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-a35658-openshift-default (combined from similar events): New size: 4; reason: All metrics below target 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 4; reason: All metrics below target 23m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 Stopping container istio-proxy 23m Normal SuccessfulDelete replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Deleted pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-39043d-openshift-default New size: 4; reason: All metrics below target 23m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz Stopping container istio-proxy 23m Normal ScalingReplicaSet deployment/e2e-worker-w3-39043d-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w3-39043d-openshift-default-644f6b79bf from 7 to 4 23m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts Stopping container istio-proxy 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-8d4127-openshift-default (combined from similar events): New size: 4; reason: All metrics below target 23m Normal SuccessfulDelete replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Deleted pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-rcbts 23m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-d6nh9 Stopping container istio-proxy 23m Normal ScalingReplicaSet deployment/e2e-worker-w2-8d4127-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w2-8d4127-openshift-default-bf8f7445c from 5 to 4 23m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Stopping container istio-proxy 23m Normal ScalingReplicaSet deployment/e2e-worker-w1-a35658-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w1-a35658-openshift-default-77fbcb7647 from 5 to 4 23m Normal SuccessfulDelete replicaset/e2e-worker-w4-f4e123-openshift-default-77f874d747 Deleted pod: e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m 23m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Readiness probe error: HTTP probe failed with statuscode: 503... 23m Normal SuccessfulDelete replicaset/e2e-worker-w1-a35658-openshift-default-77fbcb7647 Deleted pod: e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 23m Normal SuccessfulDelete replicaset/e2e-worker-w2-8d4127-openshift-default-bf8f7445c Deleted pod: e2e-worker-w2-8d4127-openshift-default-bf8f7445c-kxgcz 23m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf Readiness probe failed: HTTP probe failed with statuscode: 503 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default New size: 4; reason: All metrics below target 23m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default Scaled down replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 5 to 4 23m Normal SuccessfulDelete replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Deleted pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-7dnl6 23m Normal SuccessfulDelete replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Deleted pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p 23m Normal ScalingReplicaSet deployment/e2e-worker-w4-f4e123-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w4-f4e123-openshift-default-77f874d747 from 5 to 4 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-f4e123-openshift-default (combined from similar events): New size: 4; reason: All metrics below target 23m Normal SuccessfulDelete replicaset/e2e-worker-w3-39043d-openshift-default-644f6b79bf Deleted pod: e2e-worker-w3-39043d-openshift-default-644f6b79bf-zhnpf 23m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-4bg6p Stopping container istio-proxy 23m Normal ScalingReplicaSet deployment/e2e-worker-w6-102379-openshift-default Scaled down replica set e2e-worker-w6-102379-openshift-default-69dd54f7df from 5 to 4 23m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Readiness probe failed: HTTP probe failed with statuscode: 503 23m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Stopping container istio-proxy 23m Normal SuccessfulDelete replicaset/e2e-worker-w6-102379-openshift-default-69dd54f7df Deleted pod: e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj 23m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-102379-openshift-default New size: 4; reason: All metrics below target 23m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-qz45m Stopping container istio-proxy 23m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-l59gj Readiness probe error: HTTP probe failed with statuscode: 503... 23m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-p4828 Stopping container istio-proxy 23m Normal AddedLabel gateway/e2e-shared-b-w0-dce558 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-dce558 22m Normal ScalingReplicaSet deployment/e2e-shared-b-w0-dce558-openshift-default Scaled up replica set e2e-shared-b-w0-dce558-openshift-default-595cb8c97 from 0 to 1 22m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-dce558-openshift-default-595cb8c97 Created pod: e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t 22m Normal AddedInterface pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Add eth0 [10.134.0.155/23] from ovn-kubernetes 22m Normal Killing pod/e2e-inf-a-225668-openshift-default-765b499d89-qjf5s Stopping container istio-proxy 22m Normal Killing pod/e2e-inf-a-225668-openshift-default-765b499d89-2mjrh Stopping container istio-proxy 22m Normal Killing pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Stopping container istio-proxy 22m Warning ProbeError pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Readiness probe error: HTTP probe failed with statuscode: 503... 22m Warning Unhealthy pod/e2e-inf-a-225668-openshift-default-765b499d89-wnbmm Readiness probe failed: HTTP probe failed with statuscode: 503 22m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w0-dce558 Scaled up replica set payload-processing-e2e-shared-b-w0-dce558-566ddc874c from 0 to 1 22m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w0-dce558-566ddc874c Created pod: payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 22m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w0-dce558-566ddc874c Error creating: pods "payload-processing-e2e-shared-b-w0-dce558-566ddc874c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-dce558: serviceaccount "payload-processing-e2e-shared-b-w0-dce558" not found 22m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w0-dce558 Scaled up replica set payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff from 0 to 1 22m Normal Killing pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-l67n8 Stopping container istio-proxy 22m Normal Killing pod/e2e-inf-b-a99fad-openshift-default-8475f7788f-lzlqb Stopping container istio-proxy 22m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff Error creating: pods "payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-dce558: serviceaccount "payload-processing-e2e-shared-b-w0-dce558" not found 22m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff Created pod: payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 22m Normal Started pod/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 Container started 22m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 Add eth0 [10.132.0.179/23] from ovn-kubernetes 22m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 22m Normal Created pod/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 Container created 22m Normal SuccessfulCreate replicaset/e2e-shared-a-w5-801162-openshift-default-8499f8c557 Created pod: e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth 22m Normal AddedLabel gateway/e2e-shared-a-w5-801162 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w5-801162 22m Normal ScalingReplicaSet deployment/e2e-shared-a-w5-801162-openshift-default Scaled up replica set e2e-shared-a-w5-801162-openshift-default-8499f8c557 from 0 to 1 22m Normal AddedInterface pod/payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 Add eth0 [10.132.0.180/23] from ovn-kubernetes 22m Normal Started pod/payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 Container started 22m Normal Created pod/payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 Container created 22m Normal Pulled pod/payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Add eth0 [10.134.0.156/23] from ovn-kubernetes 22m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w5-801162 Scaled up replica set payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c from 0 to 1 22m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c Created pod: payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 22m Warning Unhealthy pod/payload-processing-e2e-inf-b-a99fad-58ff94c9ff-tjdqj Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 22m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c Error creating: pods "payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w5-801162: serviceaccount "payload-processing-e2e-shared-a-w5-801162" not found 22m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-a99fad-5488bf9fdc-krzn6 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 22m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w5-801162 Scaled up replica set payload-processing-e2e-shared-a-w5-801162-74759cf659 from 0 to 1 22m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w5-801162-74759cf659 Error creating: pods "payload-processing-e2e-shared-a-w5-801162-74759cf659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w5-801162: serviceaccount "payload-processing-e2e-shared-a-w5-801162" not found 22m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w5-801162-74759cf659 Created pod: payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m 22m Normal Started pod/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m Container started 22m Normal Created pod/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m Container created 22m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-225668-6d7866c8dc-29bbm Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 22m Normal Pulled pod/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 22m Warning Unhealthy pod/payload-processing-e2e-inf-a-225668-65675d6655-qdr5l Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 22m Normal AddedInterface pod/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m Add eth0 [10.132.0.182/23] from ovn-kubernetes 22m Normal Started pod/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 Container started 22m Normal Created pod/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 Container created 22m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 Add eth0 [10.132.0.181/23] from ovn-kubernetes 22m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 22m Normal Killing pod/payload-processing-e2e-inf-b-79c47f-746754fdd7-bnqws Stopping container payload-processing 22m Normal Killing pod/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg Stopping container payload-pre-processing 22m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-dzxw7 Stopping container istio-proxy 22m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Stopping container istio-proxy 22m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Stopping container istio-proxy 22m Normal Killing pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Stopping container istio-proxy 22m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Readiness probe error: HTTP probe failed with statuscode: 503... 22m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Readiness probe failed: HTTP probe failed with statuscode: 503 22m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-8bmvr Readiness probe error: HTTP probe failed with statuscode: 503... 22m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-fvfxs Readiness probe failed: HTTP probe failed with statuscode: 503 22m Warning ProbeError pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Readiness probe error: HTTP probe failed with statuscode: 503... 22m Warning Unhealthy pod/e2e-worker-w6-102379-openshift-default-69dd54f7df-v74q8 Readiness probe failed: HTTP probe failed with statuscode: 503 22m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-d12868-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 22m Normal ScalingReplicaSet deployment/e2e-inf-b-d12868-openshift-default Scaled up replica set e2e-inf-b-d12868-openshift-default-7f4d86c65f from 1 to 2 22m Normal SuccessfulCreate replicaset/e2e-inf-b-d12868-openshift-default-7f4d86c65f Created pod: e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx 22m Normal Created pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Container created 22m Normal Pulled pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 22m Normal Started pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Container started 22m Normal AddedInterface pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Add eth0 [10.134.0.157/23] from ovn-kubernetes 22m Normal SuccessfulCreate replicaset/e2e-inf-b-79c47f-openshift-default-556b6749b5 Created pod: e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk 22m Normal ScalingReplicaSet deployment/e2e-inf-b-79c47f-openshift-default Scaled up replica set e2e-inf-b-79c47f-openshift-default-556b6749b5 from 1 to 2 22m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-79c47f-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 22m Normal ScalingReplicaSet deployment/e2e-inf-b-f58171-openshift-default Scaled up replica set e2e-inf-b-f58171-openshift-default-77bc76bfb5 from 2 to 3 22m Warning ProbeError pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused... 22m Normal Created pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Container created 22m Normal Started pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Container started 22m Normal AddedInterface pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Add eth0 [10.134.0.159/23] from ovn-kubernetes 22m Normal Pulled pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 22m Warning Unhealthy pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused 22m Normal SuccessfulCreate replicaset/e2e-inf-b-f58171-openshift-default-77bc76bfb5 Created pod: e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r 22m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-f58171-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 22m Normal Started pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Container started 22m Normal Created pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Container created 22m Normal Pulled pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Add eth0 [10.133.0.234/23] from ovn-kubernetes 22m Normal Killing pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Stopping container istio-proxy 22m Warning Unhealthy pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused 22m Warning ProbeError pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-hkzjk Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused... 22m Normal Killing pod/e2e-inf-b-79c47f-openshift-default-556b6749b5-fcvnj Stopping container istio-proxy 22m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-79c47f-b44bd7475-6zngg Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 22m Warning ProbeError pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Startup probe error: Get "http://10.133.0.234:15021/healthz/ready": dial tcp 10.133.0.234:15021: connect: connection refused... 22m Warning Unhealthy pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Startup probe failed: Get "http://10.133.0.234:15021/healthz/ready": dial tcp 10.133.0.234:15021: connect: connection refused 22m Normal AddedLabel gateway/e2e-shared-b-w5-b30676 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w5-b30676 22m Normal ScalingReplicaSet deployment/e2e-shared-b-w5-b30676-openshift-default Scaled up replica set e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c from 0 to 1 22m Normal SuccessfulCreate replicaset/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c Created pod: e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc 22m Normal AddedInterface pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Add eth0 [10.133.0.237/23] from ovn-kubernetes 22m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5 Error creating: pods "payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w5-b30676: serviceaccount "payload-processing-e2e-shared-b-w5-b30676" not found 22m Normal AddedInterface pod/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw Add eth0 [10.132.0.185/23] from ovn-kubernetes 22m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w5-b30676 Scaled up replica set payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7 from 0 to 1 22m Normal Pulled pod/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk Add eth0 [10.132.0.186/23] from ovn-kubernetes 22m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7 Error creating: pods "payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w5-b30676: serviceaccount "payload-processing-e2e-shared-b-w5-b30676" not found 22m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5 Created pod: payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw 22m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7 Created pod: payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk 22m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w5-b30676 Scaled up replica set payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5 from 0 to 1 22m Normal Started pod/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw Container started 22m Normal Created pod/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw Container created 22m Normal Started pod/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk Container started 22m Normal Created pod/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk Container created 22m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 21m Normal Killing pod/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 Stopping container payload-processing 21m Normal Killing pod/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb Stopping container payload-pre-processing 21m Normal Killing pod/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk Stopping container payload-pre-processing 21m Normal Killing pod/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn Stopping container payload-processing 21m Warning ProbeError pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Readiness probe error: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 21m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-0486e8-openshift-default New size: 3; reason: All metrics below target 21m Normal ScalingReplicaSet deployment/e2e-worker-w5-0486e8-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 from 4 to 3 21m Warning Unhealthy pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Readiness probe failed: Get "http://10.134.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 21m Normal SuccessfulDelete replicaset/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5 Deleted pod: e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 21m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-5j766 Stopping container istio-proxy 21m Warning ProbeError pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Readiness probe error: Get "http://10.134.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 21m Warning Unhealthy pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Readiness probe failed: Get "http://10.134.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 21m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-dce558-openshift-default-595cb8c97 Created pod: e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw 21m Normal Pulled pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal Pulled pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal Pulled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w0-dce558-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 21m Normal ScalingReplicaSet deployment/e2e-shared-b-w0-dce558-openshift-default Scaled up replica set e2e-shared-b-w0-dce558-openshift-default-595cb8c97 from 1 to 2 21m Normal AddedInterface pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Add eth0 [10.133.0.242/23] from ovn-kubernetes 21m Normal Started pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Container started 21m Normal Started pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Container started 21m Normal Pulled pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal Created pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Container created 21m Normal Started pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Container started 21m Normal Started pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Container started 21m Normal Created pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Container created 21m Normal Created pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Container created 21m Normal Created pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Container created 21m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t 21m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv 21m Normal ScalingReplicaSet deployment/e2e-inf-a-11c1a8-openshift-default Scaled up replica set e2e-inf-a-11c1a8-openshift-default-6f96865fb5 from 7 to 10 21m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-11c1a8-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 21m Normal SuccessfulCreate replicaset/e2e-inf-a-11c1a8-openshift-default-6f96865fb5 (combined from similar events): Created pod: e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 21m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Container created 21m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Container started 21m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Add eth0 [10.132.0.188/23] from ovn-kubernetes 21m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Container created 21m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Container started 21m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Add eth0 [10.133.0.243/23] from ovn-kubernetes 21m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal Started pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Container started 21m Normal AddedInterface pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Add eth0 [10.132.0.187/23] from ovn-kubernetes 21m Normal Pulled pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal Created pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Container created 21m Normal Killing pod/e2e-inf-a-7a62d4-openshift-default-745855d459-jrghh Stopping container istio-proxy 21m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-7a62d4-5cdd46ddbc-txvcb Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 21m Warning FailedToRetrieveImagePullSecret pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Unable to retrieve some image pull secrets (e2e-inf-a-7a62d4-openshift-default-dockercfg-vb879); attempting to pull the image may not succeed. 21m Warning Unhealthy pod/payload-processing-e2e-inf-a-7a62d4-89cbcddfc-nhtr4 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 21m Warning Unhealthy pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Startup probe failed: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused 21m Normal Killing pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Stopping container istio-proxy 21m Warning ProbeError pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Startup probe error: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused... 21m Warning ProbeError pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused... 21m Warning Unhealthy pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused 21m Warning Unhealthy pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused 21m Warning ProbeError pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused... 21m Warning ProbeError pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused... 21m Warning Unhealthy pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused 21m Warning ProbeError pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Readiness probe error: HTTP probe failed with statuscode: 503... 21m Warning Unhealthy pod/e2e-inf-a-7a62d4-openshift-default-745855d459-qjhv7 Readiness probe failed: HTTP probe failed with statuscode: 503 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused... 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused... 21m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w3-9f3188-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 21m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w3-9f3188-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Startup probe error: Get "http://10.133.0.243:15021/healthz/ready": dial tcp 10.133.0.243:15021: connect: connection refused... 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Startup probe failed: Get "http://10.133.0.243:15021/healthz/ready": dial tcp 10.133.0.243:15021: connect: connection refused 21m Normal SuccessfulCreate replicaset/e2e-inf-b-c18bea-openshift-default-5f44c48cbf Created pod: e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 21m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-c18bea-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 21m Normal ScalingReplicaSet deployment/e2e-inf-b-c18bea-openshift-default Scaled up replica set e2e-inf-b-c18bea-openshift-default-5f44c48cbf from 1 to 2 21m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w0-dce558-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 21m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w0-dce558-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 21m Normal Started pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Container started 21m Normal Created pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Container created 21m Normal Killing pod/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx Stopping container payload-pre-processing 21m Normal Pulled pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Warning Unhealthy pod/payload-processing-e2e-inf-a-11c1a8-598fbd7d99-fzmxn Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 21m Normal Killing pod/payload-processing-e2e-inf-b-d12868-7bf6f9d95c-svxnm Stopping container payload-processing 21m Normal AddedInterface pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Add eth0 [10.133.0.245/23] from ovn-kubernetes 21m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-11c1a8-78df5d9ff9-chjdk Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wcn4l Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-gvqhp Stopping container istio-proxy 21m Warning Unhealthy pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Startup probe failed: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-n9pzp Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-pqh5t Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Stopping container istio-proxy 21m Warning ProbeError pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Startup probe error: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused... 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Stopping container istio-proxy 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Readiness probe error: HTTP probe failed with statuscode: 503... 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Readiness probe failed: HTTP probe failed with statuscode: 503 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-wsvrq Readiness probe failed: HTTP probe failed with statuscode: 503 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-k2k5m Readiness probe error: HTTP probe failed with statuscode: 503... 21m Normal SuccessfulCreate replicaset/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87 Created pod: e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r 21m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w3-9f3188-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Readiness probe error: HTTP probe failed with statuscode: 503... 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Readiness probe error: HTTP probe failed with statuscode: 503... 21m Normal SuccessfulCreate replicaset/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87 Created pod: e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-kt8f6 Readiness probe failed: HTTP probe failed with statuscode: 503 21m Normal SuccessfulCreate replicaset/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87 Created pod: e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-74snv Readiness probe failed: HTTP probe failed with statuscode: 503 21m Normal ScalingReplicaSet deployment/e2e-shared-a-w3-9f3188-openshift-default Scaled up replica set e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87 from 1 to 4 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Readiness probe failed: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused 21m Warning Unhealthy pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Readiness probe failed: HTTP probe failed with statuscode: 503 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-rcdz9 Readiness probe error: Get "http://10.134.0.130:15021/healthz/ready": dial tcp 10.134.0.130:15021: connect: connection refused... 21m Warning ProbeError pod/e2e-inf-a-11c1a8-openshift-default-6f96865fb5-jzmtx Readiness probe error: HTTP probe failed with statuscode: 503... 21m Normal Started pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Container started 21m Normal AddedInterface pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Add eth0 [10.132.0.190/23] from ovn-kubernetes 21m Normal AddedInterface pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Add eth0 [10.133.0.247/23] from ovn-kubernetes 21m Normal AddedInterface pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Add eth0 [10.134.0.164/23] from ovn-kubernetes 21m Normal Started pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Container started 21m Normal Created pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Container created 21m Normal Pulled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal Pulled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Normal Started pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Container started 21m Normal Created pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Container created 21m Normal Created pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Container created 21m Normal Pulled pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 21m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w0-dce558-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 21m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w0-dce558-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 21m Normal Killing pod/payload-pre-processing-e2e-shared-a-w3-9f3188-5f8dd694c-jzm2r Stopping container payload-pre-processing 21m Normal Killing pod/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 Stopping container payload-pre-processing 21m Normal Killing pod/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z Stopping container payload-processing 21m Normal Killing pod/payload-processing-e2e-shared-a-w3-9f3188-6575d78977-4wsvq Stopping container payload-processing 21m Warning ProbeError pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused... 21m Warning Unhealthy pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused 21m Warning Unhealthy pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused 21m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-d12868-598cd4d97f-f6tnx Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 21m Warning ProbeError pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused... 21m Warning Unhealthy pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Startup probe failed: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused 21m Warning ProbeError pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Startup probe error: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused... 21m Normal Killing pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-x9ck4 Stopping container istio-proxy 21m Normal Killing pod/e2e-inf-b-d12868-openshift-default-7f4d86c65f-qrhbx Stopping container istio-proxy 21m Normal Killing pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-rk8k7 Stopping container istio-proxy 21m Normal Killing pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-zcpqt Stopping container istio-proxy 21m Normal Killing pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-jc5wz Stopping container istio-proxy 21m Normal Killing pod/e2e-shared-a-w3-9f3188-openshift-default-679fbdfc87-k6c4r Stopping container istio-proxy 20m Normal Killing pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-hqpxm Stopping container istio-proxy 20m Normal Killing pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-vdx7r Stopping container istio-proxy 20m Normal Killing pod/e2e-inf-b-f58171-openshift-default-77bc76bfb5-jvl9d Stopping container istio-proxy 20m Normal Killing pod/payload-pre-processing-e2e-shared-a-w1-fcddeb-66f88c7459-zrsmd Stopping container payload-pre-processing 20m Normal Killing pod/payload-processing-e2e-shared-a-w1-fcddeb-7b6cccd547-cn5d8 Stopping container payload-processing 20m Normal Killing pod/payload-processing-e2e-shared-b-w3-32a584-665d8875f9-dc7rb Stopping container payload-processing 20m Normal Killing pod/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk Stopping container payload-pre-processing 20m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w0-3ff278-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 20m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w0-3ff278-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 20m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-f58171-57c45cc64c-2xsx5 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 20m Warning FailedMount pod/payload-pre-processing-e2e-shared-b-w3-32a584-546dc64c87-x9hsk MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-plugins-e2e-shared-b-w3-32a584" not found 20m Warning Unhealthy pod/payload-processing-e2e-inf-b-f58171-5cc4d546dc-kq97z Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 20m Normal Killing pod/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk Stopping container payload-processing 20m Normal Killing pod/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf Stopping container payload-pre-processing 20m Normal Killing pod/payload-processing-e2e-shared-a-w2-fa9526-55fcd67459-dv9g7 Stopping container payload-processing 20m Normal Killing pod/payload-pre-processing-e2e-shared-a-w2-fa9526-7b98b75779-6gbh9 Stopping container payload-pre-processing 20m Normal Killing pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-p26jd Stopping container istio-proxy 20m Normal Killing pod/e2e-shared-a-w1-fcddeb-openshift-default-55c6ddb6f-nfjvx Stopping container istio-proxy 20m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w0-3ff278-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 20m Normal Killing pod/e2e-shared-b-w3-32a584-openshift-default-b4b9965cc-cvgzm Stopping container istio-proxy 20m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-3ff278-openshift-default Scaled up replica set e2e-shared-a-w0-3ff278-openshift-default-7477ff4559 from 1 to 2 20m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559 Created pod: e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 20m Normal Pulled pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 20m Normal Created pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Container created 20m Normal Started pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Container started 20m Normal AddedInterface pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Add eth0 [10.133.0.251/23] from ovn-kubernetes 20m Normal Killing pod/payload-processing-e2e-shared-b-w1-2d78ea-7f5d4c49b7-xgxbm Stopping container payload-processing 20m Normal Killing pod/payload-pre-processing-e2e-shared-b-w1-2d78ea-6f997454c9-j2kr4 Stopping container payload-pre-processing 20m Normal Killing pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Stopping container istio-proxy 20m Warning ProbeError pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Startup probe error: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused... 20m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-dce558-openshift-default-595cb8c97 Created pod: e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c 20m Normal ScalingReplicaSet deployment/e2e-shared-b-w0-dce558-openshift-default Scaled up replica set e2e-shared-b-w0-dce558-openshift-default-595cb8c97 from 2 to 3 20m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w0-dce558-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 20m Warning ProbeError pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Readiness probe error: HTTP probe failed with statuscode: 503... 20m Warning Unhealthy pod/e2e-shared-a-w2-fa9526-openshift-default-677bd569b5-bs2wm Readiness probe failed: HTTP probe failed with statuscode: 503 20m Warning Unhealthy pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Startup probe failed: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused 20m Normal Killing pod/e2e-inf-a-3cee6a-openshift-default-854f54449c-4gzhl Stopping container istio-proxy 20m Normal AddedInterface pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Add eth0 [10.132.0.191/23] from ovn-kubernetes 20m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-3cee6a-544fd5876c-56hwf Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 20m Normal Pulled pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 20m Warning Unhealthy pod/payload-processing-e2e-inf-a-3cee6a-799d7c674c-fj9vk Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 20m Normal Created pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Container created 20m Normal Started pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Container started 20m Normal Killing pod/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn Stopping container payload-processing 20m Normal Killing pod/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z Stopping container payload-pre-processing 20m Warning Unhealthy pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused 20m Normal Killing pod/payload-processing-e2e-shared-b-w2-10572d-5bf85ff6df-7gk9c Stopping container payload-processing 20m Normal Killing pod/payload-pre-processing-e2e-shared-b-w2-10572d-d8dc7767-9lhq7 Stopping container payload-pre-processing 20m Warning ProbeError pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused... 20m Normal Killing pod/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn Stopping container payload-processing 20m Normal Killing pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Stopping container payload-pre-processing 20m Normal Killing pod/e2e-shared-b-w1-2d78ea-openshift-default-694d949bdf-xt9q6 Stopping container istio-proxy 20m Warning Unhealthy pod/payload-processing-e2e-inf-b-c18bea-7957fddcf9-qxzkn Readiness probe failed: timeout: failed to connect service "10.134.0.125:50052" within 1s: context deadline exceeded 20m Normal Pulled pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 20m Normal Created pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Container created 20m Normal Pulled pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 20m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w5-801162-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 20m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w5-801162-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 20m Normal Created pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Container created 20m Normal Started pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Container started 20m Normal Started pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Container started 20m Normal Killing pod/payload-pre-processing-e2e-worker-w1-a35658-5fdcfb57f5-5wrx4 Stopping container payload-pre-processing 20m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w5-b30676-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 20m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w5-b30676-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 20m Normal Killing pod/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq Stopping container payload-processing 20m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 20m Warning ProbeError pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Startup probe error: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused... 20m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w3-39043d-66d86796c5-9725z Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 20m Warning Unhealthy pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Startup probe failed: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused 20m Warning Unhealthy pod/payload-processing-e2e-worker-w3-39043d-5dbd77d679-94xqn Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 20m Warning ProbeError pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Startup probe error: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused... 20m Normal Killing pod/e2e-shared-b-w2-10572d-openshift-default-54488cd6dc-z62p8 Stopping container istio-proxy 20m Warning Unhealthy pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Startup probe failed: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused 20m Normal Killing pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-zs9fl Stopping container istio-proxy 20m Normal Killing pod/e2e-inf-b-c18bea-openshift-default-5f44c48cbf-msqf9 Stopping container istio-proxy 20m Warning Unhealthy pod/payload-processing-e2e-worker-w1-a35658-7b7d7b89cc-n97vq Readiness probe failed: timeout: failed to connect service "10.134.0.48:50052" within 1s: context deadline exceeded 19m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-wmsvl Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-hp9dn Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Stopping container istio-proxy 19m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Readiness probe failed: HTTP probe failed with statuscode: 503 19m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-ms9ps Readiness probe error: HTTP probe failed with statuscode: 503... 19m Warning ProbeError pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Readiness probe error: HTTP probe failed with statuscode: 503... 19m Warning Unhealthy pod/e2e-worker-w3-39043d-openshift-default-644f6b79bf-9qs8r Readiness probe failed: HTTP probe failed with statuscode: 503 19m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-c18bea-767ccf7f75-n8xvs Readiness probe failed: timeout: failed to connect service "10.134.0.126:50052" within 1s: context deadline exceeded 19m Normal Killing pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Stopping container payload-processing 19m Normal Killing pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Stopping container payload-pre-processing 19m Normal Killing pod/payload-pre-processing-e2e-shared-a-w4-6eb768-5f447fb8bc-bqjgq Stopping container payload-pre-processing 19m Normal Killing pod/payload-processing-e2e-shared-a-w4-6eb768-7fd7b5b985-qsb5n Stopping container payload-processing 19m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w5-801162-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 19m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w5-801162-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 19m Normal Killing pod/e2e-shared-a-w4-6eb768-openshift-default-74584fc495-kg7bf Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-fcqn8 Stopping container istio-proxy 19m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w5-b30676-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 19m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-dk95j Stopping container istio-proxy 19m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w5-b30676-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 19m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-hzdkj Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w1-a35658-openshift-default-77fbcb7647-4rn45 Stopping container istio-proxy 19m Warning Unhealthy pod/payload-processing-e2e-worker-w2-8d4127-57d7c6bdc5-d4j58 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 19m Normal Killing pod/payload-processing-e2e-shared-b-w4-b9cbea-76f64494bc-xjng2 Stopping container payload-processing 19m Normal Killing pod/payload-pre-processing-e2e-shared-b-w4-b9cbea-784c95f5cf-6lxvb Stopping container payload-pre-processing 19m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w2-8d4127-6fb576bf67-qr2v6 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 19m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-6vfvf Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-d7rfs Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Stopping container istio-proxy 19m Normal Killing pod/e2e-shared-b-w4-b9cbea-openshift-default-746c95f64f-l8m2b Stopping container istio-proxy 19m Normal Killing pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-dk9s9 Stopping container istio-proxy 19m Warning Unhealthy pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Readiness probe failed: HTTP probe failed with statuscode: 503 19m Warning ProbeError pod/e2e-worker-w2-8d4127-openshift-default-bf8f7445c-mwz5z Readiness probe error: HTTP probe failed with statuscode: 503... 19m Normal Killing pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Stopping container payload-processing 19m Normal Killing pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Stopping container payload-pre-processing 18m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w4-f4e123-7c57c65699-dbx8m Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 18m Warning Unhealthy pod/payload-processing-e2e-worker-w4-f4e123-bc4895fdf-kzp94 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 18m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-nn8wm Stopping container istio-proxy 18m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Stopping container istio-proxy 18m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Stopping container istio-proxy 18m Normal Killing pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Stopping container istio-proxy 18m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Readiness probe failed: HTTP probe failed with statuscode: 503 18m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-rxg5m Readiness probe error: HTTP probe failed with statuscode: 503... 18m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Readiness probe failed: HTTP probe failed with statuscode: 503 18m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-m264q Readiness probe error: HTTP probe failed with statuscode: 503... 18m Warning ProbeError pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Readiness probe error: HTTP probe failed with statuscode: 503... 18m Warning Unhealthy pod/e2e-worker-w4-f4e123-openshift-default-77f874d747-zv5wt Readiness probe failed: HTTP probe failed with statuscode: 503 18m Normal Killing pod/payload-processing-e2e-shared-a-w0-3ff278-76cbdc7bfc-hgc9h Stopping container payload-processing 18m Normal Killing pod/payload-pre-processing-e2e-shared-a-w0-3ff278-79b8b9644c-jqjnd Stopping container payload-pre-processing 17m Normal Killing pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-fwlw9 Stopping container istio-proxy 17m Normal Killing pod/e2e-shared-a-w0-3ff278-openshift-default-7477ff4559-ncxvp Stopping container istio-proxy 17m Normal Killing pod/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m Stopping container payload-processing 17m Normal Killing pod/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 Stopping container payload-pre-processing 17m Normal Killing pod/payload-pre-processing-e2e-shared-b-w0-dce558-77fccb9bff-qgtj8 Stopping container payload-pre-processing 17m Normal Killing pod/payload-processing-e2e-shared-b-w0-dce558-566ddc874c-ctw65 Stopping container payload-processing 17m Warning Unhealthy pod/payload-pre-processing-e2e-shared-a-w5-801162-74c864f4c-kwqd4 Readiness probe failed: timeout: failed to connect service "10.132.0.181:50052" within 1s: context deadline exceeded 17m Warning Unhealthy pod/payload-processing-e2e-shared-a-w5-801162-74759cf659-bdg8m Readiness probe failed: timeout: failed to connect service "10.132.0.182:50052" within 1s: context deadline exceeded 17m Normal Killing pod/e2e-shared-a-w5-801162-openshift-default-8499f8c557-nvjth Stopping container istio-proxy 17m Normal Killing pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Stopping container istio-proxy 17m Normal Killing pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Stopping container istio-proxy 17m Normal Killing pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Stopping container istio-proxy 17m Normal AddedInterface pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Add eth0 [10.134.0.175/23] from ovn-kubernetes 17m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w5-b30676-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 17m Normal ScalingReplicaSet deployment/e2e-shared-b-w5-b30676-openshift-default Scaled up replica set e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c from 1 to 2 17m Normal SuccessfulCreate replicaset/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c Created pod: e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk 17m Normal Pulled pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 17m Normal Created pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Container created 17m Normal Started pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Container started 17m Warning Unhealthy pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Readiness probe failed: HTTP probe failed with statuscode: 503 17m Warning ProbeError pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-ffr5c Readiness probe error: HTTP probe failed with statuscode: 503... 17m Warning ProbeError pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Readiness probe error: HTTP probe failed with statuscode: 503... 17m Warning Unhealthy pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-fvwmw Readiness probe failed: HTTP probe failed with statuscode: 503 17m Warning ProbeError pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Readiness probe error: HTTP probe failed with statuscode: 503... 17m Warning Unhealthy pod/e2e-shared-b-w0-dce558-openshift-default-595cb8c97-tgd4t Readiness probe failed: HTTP probe failed with statuscode: 503 17m Normal ScalingReplicaSet deployment/e2e-worker-w0-82dbbf-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w0-82dbbf-openshift-default-7886794857 from 4 to 3 17m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Stopping container istio-proxy 17m Normal Killing pod/payload-pre-processing-e2e-shared-b-w5-b30676-7bd74677b7-vw8sk Stopping container payload-pre-processing 17m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3 17m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-crz4q 17m Normal SuccessfulDelete replicaset/e2e-worker-w0-82dbbf-openshift-default-7886794857 Deleted pod: e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl 17m Normal Killing pod/payload-processing-e2e-shared-b-w5-b30676-5b9668d5b5-xgdqw Stopping container payload-processing 17m Warning ProbeError pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused... 17m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-crz4q Stopping container discovery 17m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 3; reason: All metrics below target 17m Warning Unhealthy pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused 17m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-82dbbf-openshift-default (combined from similar events): New size: 3; reason: All metrics below target 17m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Readiness probe error: HTTP probe failed with statuscode: 503... 17m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-rnwjl Readiness probe failed: HTTP probe failed with statuscode: 503 17m Normal Killing pod/payload-pre-processing-e2e-worker-w0-82dbbf-76cc9bd4f9-zlkq5 Stopping container payload-pre-processing 17m Normal Killing pod/payload-processing-e2e-worker-w0-82dbbf-6b6c57d8d7-lkcnn Stopping container payload-processing 17m Normal Killing pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-ln4gc Stopping container istio-proxy 17m Normal Killing pod/e2e-shared-b-w5-b30676-openshift-default-5d7b4d868c-4kpnk Stopping container istio-proxy 17m Normal Killing pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Stopping container payload-pre-processing 17m Normal Killing pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Stopping container payload-processing 17m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-xclr6 Stopping container istio-proxy 17m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Stopping container istio-proxy 17m Normal Killing pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Stopping container istio-proxy 17m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Readiness probe error: HTTP probe failed with statuscode: 503... 17m Warning ProbeError pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Readiness probe error: HTTP probe failed with statuscode: 503... 17m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-tzzww Readiness probe failed: HTTP probe failed with statuscode: 503 17m Warning Unhealthy pod/e2e-worker-w0-82dbbf-openshift-default-7886794857-cfqjf Readiness probe failed: HTTP probe failed with statuscode: 503 16m Warning Unhealthy pod/payload-processing-e2e-worker-w5-0486e8-75b78f57d7-v2ndg Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 16m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w5-0486e8-777477746c-44hdj Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 16m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-49sq9 Stopping container istio-proxy 16m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Stopping container istio-proxy 16m Normal Killing pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Stopping container istio-proxy 16m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Readiness probe error: HTTP probe failed with statuscode: 503... 16m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-jfbs5 Readiness probe failed: HTTP probe failed with statuscode: 503 16m Warning Unhealthy pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Readiness probe failed: HTTP probe failed with statuscode: 503 16m Warning ProbeError pod/e2e-worker-w5-0486e8-openshift-default-5dbcd76fb5-8j22k Readiness probe error: HTTP probe failed with statuscode: 503... 16m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-lwvfc 16m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 16m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-5db77fbd9f from 6 to 10 16m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 16m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Container started 16m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Container created 16m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Container started 16m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-h8wkg 16m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 16m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-km8l8 16m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Add eth0 [10.134.0.180/23] from ovn-kubernetes 16m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Container created 16m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Container created 16m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Add eth0 [10.133.1.18/23] from ovn-kubernetes 16m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Add eth0 [10.134.0.179/23] from ovn-kubernetes 16m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-5db77fbd9f Created pod: maas-default-gateway-openshift-default-5db77fbd9f-tdppc 16m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Container started 16m Normal AddedInterface pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Add eth0 [10.132.0.193/23] from ovn-kubernetes 16m Normal Pulled pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 16m Normal Created pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Container created 16m Normal Started pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Container started 16m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Startup probe error: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused... 16m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused 16m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused 16m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused... 16m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused 16m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused... 16m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Startup probe failed: Get "http://10.133.1.18:15021/healthz/ready": dial tcp 10.133.1.18:15021: connect: connection refused 16m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused... 15m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2 15m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 2; reason: All metrics below target 15m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-zszqv Stopping container discovery 15m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-zszqv 15m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 15m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-t5g9v Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 14m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Readiness probe error: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 14m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-7n48w Readiness probe failed: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 13m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1 13m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-9r5ng Stopping container discovery 13m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 1; reason: All metrics below target 13m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-9r5ng 13m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Readiness probe failed: Get "http://10.132.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 13m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-km8l8 Readiness probe error: Get "http://10.132.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 13m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Readiness probe error: Get "http://10.134.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 13m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-lwvfc Readiness probe failed: Get "http://10.134.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 13m Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Readiness probe failed: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 13m Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-h8wkg Readiness probe error: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 11m Normal AddedInterface pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Add eth0 [10.133.1.35/23] from ovn-kubernetes 11m Normal SuccessfulCreate replicaset/e2e-worker-single-main-030599-openshift-default-f6d7855d5 Created pod: e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj 11m Normal ScalingReplicaSet deployment/e2e-worker-single-main-030599-openshift-default Scaled up replica set e2e-worker-single-main-030599-openshift-default-f6d7855d5 from 0 to 1 11m Normal AddedLabel gateway/e2e-worker-single-main-030599 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-030599 11m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-single-main-030599 Scaled up replica set payload-pre-processing-e2e-worker-single-main-030599-5545bf967f from 0 to 1 11m Warning FailedCreate replicaset/payload-processing-e2e-worker-single-main-030599-55c7b56b7f Error creating: pods "payload-processing-e2e-worker-single-main-030599-55c7b56b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-030599: serviceaccount "payload-processing-e2e-worker-single-main-030599" not found 11m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-single-main-030599-5545bf967f Created pod: payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 11m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-single-main-030599-5545bf967f Error creating: pods "payload-pre-processing-e2e-worker-single-main-030599-5545bf967f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-030599: serviceaccount "payload-processing-e2e-worker-single-main-030599" not found 11m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-single-main-030599 Scaled up replica set payload-processing-e2e-worker-single-main-030599-55c7b56b7f from 0 to 1 11m Normal AddedInterface pod/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz Add eth0 [10.133.1.38/23] from ovn-kubernetes 11m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-single-main-030599-55c7b56b7f Created pod: payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz 11m Normal AddedInterface pod/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 Add eth0 [10.133.1.37/23] from ovn-kubernetes 11m Normal Pulled pod/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 11m Normal Created pod/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 Container created 11m Normal Started pod/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 Container started 11m Normal Created pod/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz Container created 11m Normal Pulled pod/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 11m Normal Started pod/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz Container started 11m Normal Pulled pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 11m Normal Created pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Container created 11m Normal Started pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Container started 11m Warning Unhealthy pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Startup probe failed: Get "http://10.133.1.35:15021/healthz/ready": dial tcp 10.133.1.35:15021: connect: connection refused 11m Warning ProbeError pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Startup probe error: Get "http://10.133.1.35:15021/healthz/ready": dial tcp 10.133.1.35:15021: connect: connection refused... 11m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-030599-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-030599-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 10m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-030599-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 10m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-030599-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 10m Normal Killing pod/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz Stopping container payload-processing 10m Normal Killing pod/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 Stopping container payload-pre-processing 10m Normal Killing pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Stopping container istio-proxy 10m Warning ProbeError pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Readiness probe error: Get "http://10.133.1.35:15021/healthz/ready": dial tcp 10.133.1.35:15021: connect: connection refused... 10m Warning Unhealthy pod/e2e-worker-single-main-030599-openshift-default-f6d7855d5-8zbjj Readiness probe failed: Get "http://10.133.1.35:15021/healthz/ready": dial tcp 10.133.1.35:15021: connect: connection refused 10m Warning Unhealthy pod/payload-processing-e2e-worker-single-main-030599-55c7b56b7htbnz Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 10m Warning Unhealthy pod/payload-pre-processing-e2e-worker-single-main-030599-5545bxwwg8 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 8m9s Normal AddedInterface pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Add eth0 [10.133.1.44/23] from ovn-kubernetes 8m9s Normal ScalingReplicaSet deployment/e2e-worker-single-main-794e97-openshift-default Scaled up replica set e2e-worker-single-main-794e97-openshift-default-6bd758c985 from 0 to 1 8m9s Normal AddedLabel gateway/e2e-worker-single-main-794e97 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-794e97 8m9s Normal SuccessfulCreate replicaset/e2e-worker-single-main-794e97-openshift-default-6bd758c985 Created pod: e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 8m4s Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-single-main-794e97-7b68cc6cf5 Error creating: pods "payload-pre-processing-e2e-worker-single-main-794e97-7b68cc6cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-794e97: serviceaccount "payload-processing-e2e-worker-single-main-794e97" not found 8m4s Normal Created pod/payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb Container created 8m4s Normal Started pod/payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb Container started 8m4s Warning FailedCreate replicaset/payload-processing-e2e-worker-single-main-794e97-7f5657f55c Error creating: pods "payload-processing-e2e-worker-single-main-794e97-7f5657f55c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-794e97: serviceaccount "payload-processing-e2e-worker-single-main-794e97" not found 8m4s Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-single-main-794e97 Scaled up replica set payload-processing-e2e-worker-single-main-794e97-7f5657f55c from 0 to 1 8m4s Normal AddedInterface pod/payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd Add eth0 [10.133.1.46/23] from ovn-kubernetes 8m4s Normal Pulled pod/payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 8m4s Normal Started pod/payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd Container started 8m4s Normal Created pod/payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd Container created 8m4s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-single-main-794e97 Scaled up replica set payload-pre-processing-e2e-worker-single-main-794e97-7b68cc6cf5 from 0 to 1 8m4s Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-single-main-794e97-7f5657f55c Created pod: payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb 8m4s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-single-main-794e97-7b68cc6cf5 Created pod: payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd 8m4s Normal Pulled pod/payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 8m4s Normal AddedInterface pod/payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb Add eth0 [10.133.1.47/23] from ovn-kubernetes 7m52s Normal Started pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Container started 7m52s Normal Pulled pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 7m52s Normal Created pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Container created 7m46s Warning ProbeError pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Startup probe error: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused... 7m46s Warning Unhealthy pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Startup probe failed: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused 7m24s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-794e97-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m24s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-794e97-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 6m58s Normal Killing pod/payload-pre-processing-e2e-worker-single-main-794e97-7b68cbtvpd Stopping container payload-pre-processing 6m58s Normal Killing pod/payload-processing-e2e-worker-single-main-794e97-7f5657f55lkvmb Stopping container payload-processing 6m50s Normal Killing pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Stopping container istio-proxy 6m45s Warning ProbeError pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Readiness probe error: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused... 6m45s Warning Unhealthy pod/e2e-worker-single-main-794e97-openshift-default-6bd758c985ggft8 Readiness probe failed: Get "http://10.133.1.44:15021/healthz/ready": dial tcp 10.133.1.44:15021: connect: connection refused 5m46s Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Readiness probe error: Get "http://10.133.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 5m46s Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-tdppc Readiness probe failed: Get "http://10.133.1.18:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 5m19s Normal ScalingReplicaSet deployment/e2e-ait-57cdc37c-openshift-default Scaled up replica set e2e-ait-57cdc37c-openshift-default-7cbc575ddc from 0 to 1 5m19s Normal AddedInterface pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Add eth0 [10.133.1.56/23] from ovn-kubernetes 5m19s Normal AddedLabel gateway/e2e-ait-57cdc37c Added label istio.io/rev=openshift-gateway to gateway e2e-ait-57cdc37c 5m19s Normal SuccessfulCreate replicaset/e2e-ait-57cdc37c-openshift-default-7cbc575ddc Created pod: e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw 5m15s Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-57cdc37c Scaled up replica set payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc from 0 to 1 5m15s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf Created pod: payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf 5m15s Warning FailedCreate replicaset/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc Error creating: pods "payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-57cdc37c: serviceaccount "payload-processing-e2e-ait-57cdc37c" not found 5m15s Normal Started pod/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf Container started 5m15s Normal Created pod/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf Container created 5m15s Normal Pulled pod/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 5m15s Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf Error creating: pods "payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-57cdc37c: serviceaccount "payload-processing-e2e-ait-57cdc37c" not found 5m15s Normal Pulled pod/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 5m15s Normal Started pod/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 Container started 5m15s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-57cdc37c Scaled up replica set payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf from 0 to 1 5m15s Normal AddedInterface pod/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf Add eth0 [10.133.1.58/23] from ovn-kubernetes 5m15s Normal Created pod/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 Container created 5m15s Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc Created pod: payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 5m15s Normal AddedInterface pod/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 Add eth0 [10.133.1.59/23] from ovn-kubernetes 5m3s Normal Pulled pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 5m3s Normal Created pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Container created 5m3s Normal Started pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Container started 4m58s Warning ProbeError pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Startup probe error: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused... 4m58s Warning Unhealthy pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Startup probe failed: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused 4m51s Normal Killing pod/payload-processing-e2e-ait-57cdc37c-5fdfd5b8cc-f8ch7 Stopping container payload-processing 4m51s Normal Killing pod/payload-pre-processing-e2e-ait-57cdc37c-6774ff54cf-vdnvf Stopping container payload-pre-processing 4m49s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-57cdc37c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m49s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-57cdc37c-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m45s Normal Killing pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Stopping container istio-proxy 4m43s Normal AddedLabel gateway/e2e-authcfg-http-17f6e3 Added label istio.io/rev=openshift-gateway to gateway e2e-authcfg-http-17f6e3 4m43s Normal SuccessfulCreate replicaset/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85 Created pod: e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf 4m43s Normal ScalingReplicaSet deployment/e2e-authcfg-http-17f6e3-openshift-default Scaled up replica set e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85 from 0 to 1 4m42s Warning Unhealthy pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Readiness probe failed: HTTP probe failed with statuscode: 503 4m42s Warning ProbeError pod/e2e-ait-57cdc37c-openshift-default-7cbc575ddc-pn9xw Readiness probe error: HTTP probe failed with statuscode: 503... 4m42s Normal AddedInterface pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Add eth0 [10.133.1.60/23] from ovn-kubernetes 4m39s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-authcfg-http-17f6e3 Scaled up replica set payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c from 0 to 1 4m39s Normal ScalingReplicaSet deployment/payload-processing-e2e-authcfg-http-17f6e3 Scaled up replica set payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f from 0 to 1 4m38s Normal AddedInterface pod/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv Add eth0 [10.133.1.62/23] from ovn-kubernetes 4m38s Normal Created pod/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv Container created 4m38s Normal AddedInterface pod/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh Add eth0 [10.133.1.63/23] from ovn-kubernetes 4m38s Normal Pulled pod/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 4m38s Normal Started pod/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh Container started 4m38s Normal Started pod/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv Container started 4m38s Warning FailedCreate replicaset/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c Error creating: pods "payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-authcfg-http-17f6e3: serviceaccount "payload-processing-e2e-authcfg-http-17f6e3" not found 4m38s Normal Created pod/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh Container created 4m38s Warning FailedCreate replicaset/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f Error creating: pods "payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-authcfg-http-17f6e3: serviceaccount "payload-processing-e2e-authcfg-http-17f6e3" not found 4m38s Normal SuccessfulCreate replicaset/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f Created pod: payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh 4m38s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c Created pod: payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv 4m38s Normal Pulled pod/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 4m28s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-authcfg-http-17f6e3-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m28s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-authcfg-http-17f6e3-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m26s Normal Started pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Container started 4m26s Normal Pulled pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 4m26s Normal Created pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Container created 4m21s Warning ProbeError pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Startup probe error: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused... 4m21s Warning Unhealthy pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Startup probe failed: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused 3m58s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-authcfg-http-17f6e3-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 3m58s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-authcfg-http-17f6e3-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 2m52s Normal Killing pod/payload-pre-processing-e2e-authcfg-http-17f6e3-57fd7cc66c-vqppv Stopping container payload-pre-processing 2m52s Normal Killing pod/payload-processing-e2e-authcfg-http-17f6e3-7b454fcc5f-r4jlh Stopping container payload-processing 2m39s Normal Killing pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Stopping container istio-proxy 2m35s Warning Unhealthy pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Readiness probe failed: HTTP probe failed with statuscode: 503 2m35s Warning ProbeError pod/e2e-authcfg-http-17f6e3-openshift-default-78ddcdcf85-pbxrf Readiness probe error: HTTP probe failed with statuscode: 503... 108s Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 108s Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-bg7cl Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 108s Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 108s Warning ProbeError pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 108s Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-cz4nm Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 108s Warning Unhealthy pod/maas-default-gateway-openshift-default-5db77fbd9f-lx2rx Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)