=== events in openshift-ingress (2026-11-03T20:50:25Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 43m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lfrxk to ip-10-0-134-178.us-east-2.compute.internal 65m Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f to ip-10-0-134-178.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Successfully assigned openshift-ingress/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww to ip-10-0-134-178.us-east-2.compute.internal 64m Normal Scheduled pod/kube-auth-proxy-6dd88dbbb7-48gc7 Successfully assigned openshift-ingress/kube-auth-proxy-6dd88dbbb7-48gc7 to ip-10-0-128-24.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Successfully assigned openshift-ingress/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 to ip-10-0-142-244.us-east-2.compute.internal 64m Normal Scheduled pod/kube-auth-proxy-6dd88dbbb7-j2xmd Successfully assigned openshift-ingress/kube-auth-proxy-6dd88dbbb7-j2xmd to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q Successfully assigned openshift-ingress/e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q to ip-10-0-142-244.us-east-2.compute.internal 37m Warning FailedScheduling pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 37m Warning FailedScheduling pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 37m Normal Scheduled pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Successfully assigned openshift-ingress/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-vk8mm Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vk8mm to ip-10-0-134-178.us-east-2.compute.internal 43m Normal Scheduled pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Successfully assigned openshift-ingress/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx to ip-10-0-142-244.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm to ip-10-0-134-178.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s to ip-10-0-134-178.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b to ip-10-0-142-244.us-east-2.compute.internal 43m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qrs7z to ip-10-0-128-24.us-east-2.compute.internal 38m Warning FailedScheduling pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Warning FailedScheduling pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 43m Normal Scheduled pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Successfully assigned openshift-ingress/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm to ip-10-0-142-244.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-28w6h to ip-10-0-128-24.us-east-2.compute.internal 10m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2cl2z to ip-10-0-142-244.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2n8gb to ip-10-0-142-244.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Successfully assigned openshift-ingress/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl to ip-10-0-134-178.us-east-2.compute.internal 5m17s Normal Scheduled pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Successfully assigned openshift-ingress/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 to ip-10-0-134-178.us-east-2.compute.internal 31m Warning FailedScheduling pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 10m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-2z5gd to ip-10-0-134-178.us-east-2.compute.internal 22m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-45b2b to ip-10-0-142-244.us-east-2.compute.internal 12m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-4f6wl Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-4f6wl to ip-10-0-128-24.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-4vnbx to ip-10-0-134-178.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Successfully assigned openshift-ingress/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh to ip-10-0-142-244.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-7krc7 to ip-10-0-142-244.us-east-2.compute.internal 12m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-8bcwd to ip-10-0-134-178.us-east-2.compute.internal 22m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-cwz84 to ip-10-0-142-244.us-east-2.compute.internal 10m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-fj62v to ip-10-0-142-244.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-gmqdl to ip-10-0-134-178.us-east-2.compute.internal 71m Normal Scheduled pod/router-default-855cd4cff-prjqj Successfully assigned openshift-ingress/router-default-855cd4cff-prjqj to ip-10-0-134-178.us-east-2.compute.internal 71m Warning FailedScheduling pod/router-default-855cd4cff-prjqj no nodes available to schedule pods 44m Normal Scheduled pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Successfully assigned openshift-ingress/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq to ip-10-0-128-24.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg to ip-10-0-142-244.us-east-2.compute.internal 37m Normal Scheduled pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Successfully assigned openshift-ingress/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q to ip-10-0-142-244.us-east-2.compute.internal 37m Warning FailedScheduling pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-h7vtl to ip-10-0-134-178.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Successfully assigned openshift-ingress/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck to ip-10-0-134-178.us-east-2.compute.internal 31m Warning FailedScheduling pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 48m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw to ip-10-0-134-178.us-east-2.compute.internal 10m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-k6fhj to ip-10-0-128-24.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-kpkjt to ip-10-0-142-244.us-east-2.compute.internal 12m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-krhrv to ip-10-0-142-244.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Successfully assigned openshift-ingress/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq to ip-10-0-142-244.us-east-2.compute.internal 10m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-lc2bv to ip-10-0-134-178.us-east-2.compute.internal 65m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p994c to ip-10-0-134-178.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-rrs66 to ip-10-0-128-24.us-east-2.compute.internal 37m Normal Scheduled pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Successfully assigned openshift-ingress/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz to ip-10-0-142-244.us-east-2.compute.internal 51m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-sk7xk to ip-10-0-128-24.us-east-2.compute.internal 49m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx to ip-10-0-134-178.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f to ip-10-0-128-24.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 to ip-10-0-128-24.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m to ip-10-0-134-178.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb to ip-10-0-142-244.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll to ip-10-0-142-244.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl to ip-10-0-142-244.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Successfully assigned openshift-ingress/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d to ip-10-0-134-178.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc to ip-10-0-128-24.us-east-2.compute.internal 77m Warning FailedScheduling pod/router-default-855cd4cff-prjqj no nodes available to schedule pods 33m Normal Scheduled pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Successfully assigned openshift-ingress/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 to ip-10-0-142-244.us-east-2.compute.internal 34m Warning FailedScheduling pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 34m Warning FailedScheduling pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 22m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-vbhfd to ip-10-0-128-24.us-east-2.compute.internal 10m Normal Scheduled pod/maas-default-gateway-openshift-default-fcb75c45f-wp8sz Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wp8sz to ip-10-0-128-24.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Successfully assigned openshift-ingress/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw to ip-10-0-134-178.us-east-2.compute.internal 25m Normal Scheduled pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Successfully assigned openshift-ingress/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn to ip-10-0-134-178.us-east-2.compute.internal 50m Normal Scheduled pod/payload-pre-processing-7b98bb678c-qg778 Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-qg778 to ip-10-0-142-244.us-east-2.compute.internal 49m Normal Scheduled pod/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz Successfully assigned openshift-ingress/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz to ip-10-0-142-244.us-east-2.compute.internal 48m Normal Scheduled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Successfully assigned openshift-ingress/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m to ip-10-0-128-24.us-east-2.compute.internal 30m Normal Scheduled pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Successfully assigned openshift-ingress/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl to ip-10-0-142-244.us-east-2.compute.internal 30m Warning FailedScheduling pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 35m Warning FailedScheduling pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 43m Normal Scheduled pod/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm to ip-10-0-142-244.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl to ip-10-0-128-24.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Successfully assigned openshift-ingress/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq to ip-10-0-134-178.us-east-2.compute.internal 38m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9cmmw to ip-10-0-128-24.us-east-2.compute.internal 38m Warning FailedScheduling pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node. 38m Warning FailedScheduling pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: not eligible due to a terminating pod on the nominated node. 38m Warning FailedScheduling pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw 0/3 nodes are available: 3 Insufficient cpu. 49m Normal Scheduled pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 to ip-10-0-134-178.us-east-2.compute.internal 24m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc to ip-10-0-142-244.us-east-2.compute.internal 5m13s Normal Scheduled pod/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp to ip-10-0-142-244.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Successfully assigned openshift-ingress/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl to ip-10-0-134-178.us-east-2.compute.internal 63m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-85svm Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-85svm to ip-10-0-142-244.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j to ip-10-0-142-244.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt to ip-10-0-134-178.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Successfully assigned openshift-ingress/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl to ip-10-0-142-244.us-east-2.compute.internal 49m Normal Scheduled pod/payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb to ip-10-0-142-244.us-east-2.compute.internal 32m Warning FailedScheduling pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 41m Normal Scheduled pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Successfully assigned openshift-ingress/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 to ip-10-0-142-244.us-east-2.compute.internal 32m Warning FailedScheduling pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 39m Warning FailedScheduling pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 40m Normal Scheduled pod/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 to ip-10-0-142-244.us-east-2.compute.internal 64m Normal Scheduled pod/data-science-gateway-data-science-gateway-class-7c689579c-pv54h Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-pv54h to ip-10-0-134-178.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz to ip-10-0-128-24.us-east-2.compute.internal 39m Normal Scheduled pod/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc to ip-10-0-134-178.us-east-2.compute.internal 39m Warning ClusterIPNotAllocated service/payload-pre-processing-e2e-api-a-433102 Cluster IP [IPv4]: 172.31.66.165 is not allocated; repairing 41m Normal Scheduled pod/payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc to ip-10-0-134-178.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp to ip-10-0-128-24.us-east-2.compute.internal 65m Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-b8qdl Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-b8qdl to ip-10-0-142-244.us-east-2.compute.internal 37m Normal Scheduled pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Successfully assigned openshift-ingress/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz to ip-10-0-128-24.us-east-2.compute.internal 38m Normal Preempted pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Preempted by pod 026a1ca8-f2a5-4f87-8adb-b1a8125d0c25 on node ip-10-0-128-24.us-east-2.compute.internal 26m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr to ip-10-0-134-178.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z to ip-10-0-142-244.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Successfully assigned openshift-ingress/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq to ip-10-0-142-244.us-east-2.compute.internal 38m Warning FailedScheduling pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 40m Normal Scheduled pod/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w to ip-10-0-142-244.us-east-2.compute.internal 38m Normal Scheduled pod/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg to ip-10-0-142-244.us-east-2.compute.internal 49m Normal Scheduled pod/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr to ip-10-0-142-244.us-east-2.compute.internal 4m36s Normal Scheduled pod/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt Successfully assigned openshift-ingress/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt to ip-10-0-142-244.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Successfully assigned openshift-ingress/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc to ip-10-0-142-244.us-east-2.compute.internal 38m Warning FailedScheduling pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w to ip-10-0-142-244.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d to ip-10-0-142-244.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj to ip-10-0-128-24.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Successfully assigned openshift-ingress/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 to ip-10-0-134-178.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv to ip-10-0-134-178.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz to ip-10-0-142-244.us-east-2.compute.internal 37m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 to ip-10-0-142-244.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Successfully assigned openshift-ingress/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 to ip-10-0-134-178.us-east-2.compute.internal 36m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 to ip-10-0-134-178.us-east-2.compute.internal 36m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf to ip-10-0-134-178.us-east-2.compute.internal 38m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 to ip-10-0-134-178.us-east-2.compute.internal 8m6s Normal Scheduled pod/payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm to ip-10-0-142-244.us-east-2.compute.internal 12m Normal Scheduled pod/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d to ip-10-0-134-178.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp to ip-10-0-142-244.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Successfully assigned openshift-ingress/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz to ip-10-0-134-178.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z to ip-10-0-134-178.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 to ip-10-0-142-244.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 to ip-10-0-134-178.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk to ip-10-0-134-178.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 to ip-10-0-128-24.us-east-2.compute.internal 41m Normal Scheduled pod/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 to ip-10-0-134-178.us-east-2.compute.internal 29m Normal Scheduled pod/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 to ip-10-0-134-178.us-east-2.compute.internal 29m Normal Scheduled pod/payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss to ip-10-0-142-244.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 to ip-10-0-128-24.us-east-2.compute.internal 32m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 to ip-10-0-128-24.us-east-2.compute.internal 39m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws to ip-10-0-134-178.us-east-2.compute.internal 39m Normal Scheduled pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Successfully assigned openshift-ingress/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv to ip-10-0-142-244.us-east-2.compute.internal 37m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 to ip-10-0-142-244.us-east-2.compute.internal 31m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm to ip-10-0-142-244.us-east-2.compute.internal 30m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs to ip-10-0-134-178.us-east-2.compute.internal 42m Normal Scheduled pod/payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd to ip-10-0-142-244.us-east-2.compute.internal 49m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt to ip-10-0-134-178.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Successfully assigned openshift-ingress/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x to ip-10-0-134-178.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Successfully assigned openshift-ingress/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl to ip-10-0-128-24.us-east-2.compute.internal 43m Normal Scheduled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Successfully assigned openshift-ingress/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 to ip-10-0-134-178.us-east-2.compute.internal 36m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd to ip-10-0-142-244.us-east-2.compute.internal 8m11s Normal Scheduled pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Successfully assigned openshift-ingress/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f to ip-10-0-142-244.us-east-2.compute.internal 37m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz to ip-10-0-134-178.us-east-2.compute.internal 37m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt to ip-10-0-142-244.us-east-2.compute.internal 29m Normal Scheduled pod/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r to ip-10-0-142-244.us-east-2.compute.internal 29m Normal Scheduled pod/payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg to ip-10-0-142-244.us-east-2.compute.internal 38m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx to ip-10-0-142-244.us-east-2.compute.internal 12m Normal Scheduled pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Successfully assigned openshift-ingress/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h to ip-10-0-142-244.us-east-2.compute.internal 43m Normal Scheduled pod/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 to ip-10-0-142-244.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s to ip-10-0-128-24.us-east-2.compute.internal 41m Normal Scheduled pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Successfully assigned openshift-ingress/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v to ip-10-0-134-178.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Successfully assigned openshift-ingress/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 to ip-10-0-128-24.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Successfully assigned openshift-ingress/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc to ip-10-0-142-244.us-east-2.compute.internal 43m Normal Scheduled pod/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p to ip-10-0-134-178.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 to ip-10-0-128-24.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w to ip-10-0-142-244.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Successfully assigned openshift-ingress/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d to ip-10-0-142-244.us-east-2.compute.internal 39m Normal Scheduled pod/payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc Successfully assigned openshift-ingress/payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc to ip-10-0-142-244.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w to ip-10-0-134-178.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm to ip-10-0-128-24.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq to ip-10-0-134-178.us-east-2.compute.internal 26m Normal Scheduled pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Successfully assigned openshift-ingress/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk Successfully assigned openshift-ingress/payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 Successfully assigned openshift-ingress/payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 to ip-10-0-142-244.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 to ip-10-0-134-178.us-east-2.compute.internal 24m Normal Scheduled pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Successfully assigned openshift-ingress/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h to ip-10-0-128-24.us-east-2.compute.internal 4m41s Normal Scheduled pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Successfully assigned openshift-ingress/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 to ip-10-0-142-244.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Successfully assigned openshift-ingress/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Successfully assigned openshift-ingress/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m to ip-10-0-142-244.us-east-2.compute.internal 39m Warning FailedScheduling pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 42m Normal Scheduled pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Successfully assigned openshift-ingress/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc to ip-10-0-134-178.us-east-2.compute.internal 39m Warning FailedScheduling pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 43m Normal Scheduled pod/payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx to ip-10-0-142-244.us-east-2.compute.internal 38m Normal Scheduled pod/payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw to ip-10-0-134-178.us-east-2.compute.internal 37m Normal Scheduled pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v to ip-10-0-134-178.us-east-2.compute.internal 37m Warning FailedScheduling pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 37m Warning FailedScheduling pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 37m Normal Scheduled pod/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq to ip-10-0-134-178.us-east-2.compute.internal 36m Normal Scheduled pod/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 to ip-10-0-142-244.us-east-2.compute.internal 30m Normal Scheduled pod/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx to ip-10-0-134-178.us-east-2.compute.internal 31m Normal Scheduled pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk to ip-10-0-128-24.us-east-2.compute.internal 31m Warning FailedScheduling pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Successfully assigned openshift-ingress/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b to ip-10-0-134-178.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq to ip-10-0-128-24.us-east-2.compute.internal 38m Normal Preempted pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Preempted by pod 026a1ca8-f2a5-4f87-8adb-b1a8125d0c25 on node ip-10-0-128-24.us-east-2.compute.internal 26m Normal Scheduled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Successfully assigned openshift-ingress/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss to ip-10-0-134-178.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx to ip-10-0-142-244.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj to ip-10-0-134-178.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 to ip-10-0-128-24.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Successfully assigned openshift-ingress/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm to ip-10-0-142-244.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Successfully assigned openshift-ingress/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn to ip-10-0-134-178.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf to ip-10-0-142-244.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Successfully assigned openshift-ingress/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp to ip-10-0-142-244.us-east-2.compute.internal 37m Normal Scheduled pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Successfully assigned openshift-ingress/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md to ip-10-0-142-244.us-east-2.compute.internal 31m Warning FailedScheduling pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 37m Normal Scheduled pod/payload-processing-e2e-inf-a-663013-848b6d9486-s696n Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-663013-848b6d9486-s696n to ip-10-0-128-24.us-east-2.compute.internal 39m Normal Scheduled pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t to ip-10-0-134-178.us-east-2.compute.internal 32m Normal Scheduled pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j to ip-10-0-142-244.us-east-2.compute.internal 32m Warning FailedScheduling pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Normal Scheduled pod/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 to ip-10-0-134-178.us-east-2.compute.internal 36m Normal Scheduled pod/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n to ip-10-0-142-244.us-east-2.compute.internal 36m Normal Scheduled pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck to ip-10-0-142-244.us-east-2.compute.internal 37m Normal Scheduled pod/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm to ip-10-0-128-24.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Successfully assigned openshift-ingress/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 to ip-10-0-142-244.us-east-2.compute.internal 48m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l to ip-10-0-142-244.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Successfully assigned openshift-ingress/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 to ip-10-0-128-24.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 to ip-10-0-128-24.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Successfully assigned openshift-ingress/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl to ip-10-0-134-178.us-east-2.compute.internal 36m Normal Scheduled pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Successfully assigned openshift-ingress/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Successfully assigned openshift-ingress/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx to ip-10-0-134-178.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r Successfully assigned openshift-ingress/payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r to ip-10-0-142-244.us-east-2.compute.internal 4m36s Normal Scheduled pod/payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq Successfully assigned openshift-ingress/payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd to ip-10-0-142-244.us-east-2.compute.internal 38m Normal Scheduled pod/payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x Successfully assigned openshift-ingress/payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz to ip-10-0-134-178.us-east-2.compute.internal 31m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 31m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 39m Normal Scheduled pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 to ip-10-0-134-178.us-east-2.compute.internal 40m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb to ip-10-0-134-178.us-east-2.compute.internal 43m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh to ip-10-0-142-244.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Successfully assigned openshift-ingress/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc to ip-10-0-142-244.us-east-2.compute.internal 34m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f to ip-10-0-134-178.us-east-2.compute.internal 41m Normal Scheduled pod/payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp to ip-10-0-134-178.us-east-2.compute.internal 39m Normal Scheduled pod/payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd Successfully assigned openshift-ingress/payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd to ip-10-0-134-178.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch to ip-10-0-134-178.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Successfully assigned openshift-ingress/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q to ip-10-0-134-178.us-east-2.compute.internal 40m Normal Scheduled pod/payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 to ip-10-0-134-178.us-east-2.compute.internal 48m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Successfully assigned openshift-ingress/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m to ip-10-0-128-24.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s to ip-10-0-142-244.us-east-2.compute.internal 34m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j to ip-10-0-134-178.us-east-2.compute.internal 31m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 29m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc to ip-10-0-128-24.us-east-2.compute.internal 31m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 49m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Successfully assigned openshift-ingress/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr to ip-10-0-142-244.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx to ip-10-0-134-178.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv Successfully assigned openshift-ingress/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv to ip-10-0-134-178.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Successfully assigned openshift-ingress/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs to ip-10-0-128-24.us-east-2.compute.internal 43m Normal Scheduled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Successfully assigned openshift-ingress/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq to ip-10-0-142-244.us-east-2.compute.internal 34m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Successfully assigned openshift-ingress/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp to ip-10-0-128-24.us-east-2.compute.internal 47m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s to ip-10-0-142-244.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr to ip-10-0-134-178.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd to ip-10-0-142-244.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 to ip-10-0-142-244.us-east-2.compute.internal 44m Normal Scheduled pod/payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq Successfully assigned openshift-ingress/payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq to ip-10-0-134-178.us-east-2.compute.internal 5m13s Normal Scheduled pod/payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm Successfully assigned openshift-ingress/payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm to ip-10-0-142-244.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l to ip-10-0-134-178.us-east-2.compute.internal 34m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 to ip-10-0-142-244.us-east-2.compute.internal 48m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 to ip-10-0-134-178.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd to ip-10-0-128-24.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 to ip-10-0-142-244.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k to ip-10-0-128-24.us-east-2.compute.internal 29m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg to ip-10-0-142-244.us-east-2.compute.internal 31m Normal Scheduled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Successfully assigned openshift-ingress/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl to ip-10-0-134-178.us-east-2.compute.internal 43m Normal Scheduled pod/payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm Successfully assigned openshift-ingress/payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm to ip-10-0-134-178.us-east-2.compute.internal 31m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 34m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 33m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 33m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 to ip-10-0-128-24.us-east-2.compute.internal 31m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 29m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 to ip-10-0-142-244.us-east-2.compute.internal 42m Normal Scheduled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Successfully assigned openshift-ingress/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt to ip-10-0-134-178.us-east-2.compute.internal 27m Normal Scheduled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Successfully assigned openshift-ingress/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g to ip-10-0-128-24.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Successfully assigned openshift-ingress/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f to ip-10-0-134-178.us-east-2.compute.internal 50m Normal Scheduled pod/payload-processing-7bb9489676-dj76x Successfully assigned openshift-ingress/payload-processing-7bb9489676-dj76x to ip-10-0-142-244.us-east-2.compute.internal 40m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp to ip-10-0-134-178.us-east-2.compute.internal 42m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq to ip-10-0-134-178.us-east-2.compute.internal 34m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 33m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg to ip-10-0-142-244.us-east-2.compute.internal 25m Normal Scheduled pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Successfully assigned openshift-ingress/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh to ip-10-0-134-178.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk to ip-10-0-128-24.us-east-2.compute.internal 29m Normal Scheduled pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Successfully assigned openshift-ingress/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb to ip-10-0-142-244.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv to ip-10-0-142-244.us-east-2.compute.internal 32m Normal Scheduled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Successfully assigned openshift-ingress/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 to ip-10-0-142-244.us-east-2.compute.internal 32m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 34m Warning FailedScheduling pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 49m Normal Scheduled pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 to ip-10-0-134-178.us-east-2.compute.internal 34m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 32m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk to ip-10-0-128-24.us-east-2.compute.internal 46m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d to ip-10-0-128-24.us-east-2.compute.internal 28m Normal Scheduled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Successfully assigned openshift-ingress/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx to ip-10-0-134-178.us-east-2.compute.internal 29m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb to ip-10-0-134-178.us-east-2.compute.internal 29m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww to ip-10-0-142-244.us-east-2.compute.internal 41m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt to ip-10-0-142-244.us-east-2.compute.internal 45m Normal Scheduled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Successfully assigned openshift-ingress/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk to ip-10-0-128-24.us-east-2.compute.internal 12m Normal Scheduled pod/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 to ip-10-0-142-244.us-east-2.compute.internal 8m6s Normal Scheduled pod/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 to ip-10-0-134-178.us-east-2.compute.internal 36m Warning FailedScheduling pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 36m Normal Scheduled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Successfully assigned openshift-ingress/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 to ip-10-0-134-178.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Successfully assigned openshift-ingress/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw to ip-10-0-128-24.us-east-2.compute.internal 38m Warning FailedScheduling pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Warning FailedScheduling pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 31m Warning FailedScheduling pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7pcns 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 36m Warning FailedScheduling pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7pcns 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 49m Normal Scheduled pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j to ip-10-0-134-178.us-east-2.compute.internal 49m Normal Scheduled pod/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx to ip-10-0-134-178.us-east-2.compute.internal 38m Normal Preempted pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 Preempted by pod 026a1ca8-f2a5-4f87-8adb-b1a8125d0c25 on node ip-10-0-128-24.us-east-2.compute.internal 38m Normal Scheduled pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 Successfully assigned openshift-ingress/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 to ip-10-0-128-24.us-east-2.compute.internal 49m Normal Scheduled pod/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd to ip-10-0-142-244.us-east-2.compute.internal 49m Normal Scheduled pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc to ip-10-0-134-178.us-east-2.compute.internal 44m Normal Scheduled pod/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k to ip-10-0-142-244.us-east-2.compute.internal 77m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-855cd4cff from 0 to 1 77m Normal SuccessfulCreate replicaset/router-default-855cd4cff Created pod: router-default-855cd4cff-prjqj 77m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 77m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 77m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 71m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 71m Warning FailedMount pod/router-default-855cd4cff-prjqj MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 71m Warning FailedMount pod/router-default-855cd4cff-prjqj MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 70m Normal Created pod/router-default-855cd4cff-prjqj Container created 70m Normal Started pod/router-default-855cd4cff-prjqj Container started 70m Normal AddedInterface pod/router-default-855cd4cff-prjqj Add eth0 [10.132.0.9/23] from ovn-kubernetes 70m Normal Pulled pod/router-default-855cd4cff-prjqj Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 65m Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 65m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-b8qdl 65m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 65m Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-b8qdl Add eth0 [10.133.0.15/23] from ovn-kubernetes 65m Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-b8qdl Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 65m Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-b8qdl Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.487s (3.487s including waiting). Image size: 185476477 bytes. 65m Normal Created pod/istiod-openshift-gateway-7876bfcb74-b8qdl Container created 65m Normal Started pod/istiod-openshift-gateway-7876bfcb74-b8qdl Container started 65m Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-b8qdl Readiness probe error: HTTP probe failed with statuscode: 503... 65m Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-b8qdl Readiness probe failed: HTTP probe failed with statuscode: 503 65m Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f Add eth0 [10.132.0.37/23] from ovn-kubernetes 65m Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 65m Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 65m Normal Pulling pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 65m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Add eth0 [10.132.0.36/23] from ovn-kubernetes 65m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-fcb75c45f from 0 to 1 65m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-p994c 65m Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-74987c9b47 Created pod: openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f 65m Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-74987c9b47 from 0 to 1 65m Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 65m Normal Started pod/openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f Container started 65m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.764s (3.764s including waiting). Image size: 183555333 bytes. 65m Normal Created pod/openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f Container created 65m Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-74987c9b47-8gh6f Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.045s (4.045s including waiting). Image size: 183555333 bytes. 64m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 64m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 64m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 64m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 64m Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-7c689579c from 0 to 1 64m Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-7c689579c Created pod: data-science-gateway-data-science-gateway-class-7c689579c-pv54h 64m Normal SuccessfulCreate replicaset/kube-auth-proxy-6dd88dbbb7 Created pod: kube-auth-proxy-6dd88dbbb7-48gc7 64m Normal SuccessfulCreate replicaset/kube-auth-proxy-6dd88dbbb7 Created pod: kube-auth-proxy-6dd88dbbb7-j2xmd 64m Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-6dd88dbbb7 from 0 to 2 64m Normal AddedInterface pod/kube-auth-proxy-6dd88dbbb7-j2xmd Add eth0 [10.133.0.19/23] from ovn-kubernetes 64m Normal Pulling pod/kube-auth-proxy-6dd88dbbb7-j2xmd Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 64m Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-7c689579c-pv54h Add eth0 [10.132.0.42/23] from ovn-kubernetes 64m Normal Pulled pod/data-science-gateway-data-science-gateway-class-7c689579c-pv54h Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 64m Normal Created pod/data-science-gateway-data-science-gateway-class-7c689579c-pv54h Container created 64m Normal Started pod/data-science-gateway-data-science-gateway-class-7c689579c-pv54h Container started 64m Normal AddedInterface pod/kube-auth-proxy-6dd88dbbb7-48gc7 Add eth0 [10.134.0.29/23] from ovn-kubernetes 64m Normal Pulling pod/kube-auth-proxy-6dd88dbbb7-48gc7 Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 64m Normal Pulled pod/kube-auth-proxy-6dd88dbbb7-48gc7 Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.358s (2.358s including waiting). Image size: 188904677 bytes. 64m Normal Created pod/kube-auth-proxy-6dd88dbbb7-48gc7 Container created 64m Normal Started pod/kube-auth-proxy-6dd88dbbb7-48gc7 Container started 64m Normal Pulled pod/kube-auth-proxy-6dd88dbbb7-j2xmd Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.41s (3.41s including waiting). Image size: 188904677 bytes. 64m Normal Created pod/kube-auth-proxy-6dd88dbbb7-j2xmd Container created 64m Normal Started pod/kube-auth-proxy-6dd88dbbb7-j2xmd Container started 63m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 63m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 63m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 63m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 63m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 63m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 63m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 63m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 63m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 63m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-85svm 63m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-85svm Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 63m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-85svm Container started 63m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-85svm Container created 63m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-85svm Add eth0 [10.133.0.22/23] from ovn-kubernetes 63m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-85svm Readiness probe failed: HTTP probe failed with statuscode: 503 63m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-85svm Readiness probe error: HTTP probe failed with statuscode: 503... 63m Normal Killing pod/istiod-openshift-gateway-7876bfcb74-b8qdl Stopping container discovery 63m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-b8qdl 63m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 62m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 62m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 52m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 52m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Container started 52m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Container created 51m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 51m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused... 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-kpkjt 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Add eth0 [10.134.0.40/23] from ovn-kubernetes 51m Normal Pulling pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 51m Normal Pulling pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-28w6h 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Container created 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Add eth0 [10.133.0.25/23] from ovn-kubernetes 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Add eth0 [10.132.0.50/23] from ovn-kubernetes 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Container started 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-gmqdl 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.132s (3.132s including waiting). Image size: 183555333 bytes. 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Container started 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Container created 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Container started 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.734s (3.734s including waiting). Image size: 183555333 bytes. 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Container created 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused... 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Startup probe failed: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Startup probe error: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused... 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused... 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-h7vtl 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Add eth0 [10.134.0.41/23] from ovn-kubernetes 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Container created 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Container started 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Container created 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-2n8gb 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Add eth0 [10.133.0.26/23] from ovn-kubernetes 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 8; reason: All metrics below target 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Container started 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Add eth0 [10.133.0.27/23] from ovn-kubernetes 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-rrs66 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Container created 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-7krc7 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Container started 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Add eth0 [10.132.0.51/23] from ovn-kubernetes 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Container started 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Container created 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused... 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused... 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Startup probe error: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused... 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Startup probe failed: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused... 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-sk7xk 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Add eth0 [10.134.0.42/23] from ovn-kubernetes 51m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-4vnbx 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Container started 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Container created 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Add eth0 [10.132.0.52/23] from ovn-kubernetes 51m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 10; reason: All metrics below target 51m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Container created 51m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Container started 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused... 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused 51m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused 51m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused... 50m Warning FailedCreate replicaset/payload-pre-processing-7b98bb678c Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 50m Normal ScalingReplicaSet deployment/payload-pre-processing Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 50m Warning FailedCreate replicaset/payload-processing-7bb9489676 Error creating: pods "payload-processing-7bb9489676-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 50m Normal SuccessfulCreate replicaset/payload-processing-7bb9489676 Created pod: payload-processing-7bb9489676-dj76x 50m Normal SuccessfulCreate replicaset/payload-pre-processing-7b98bb678c Created pod: payload-pre-processing-7b98bb678c-qg778 50m Normal ScalingReplicaSet deployment/payload-processing Scaled up replica set payload-processing-7bb9489676 from 0 to 1 50m Normal AddedInterface pod/payload-pre-processing-7b98bb678c-qg778 Add eth0 [10.133.0.33/23] from ovn-kubernetes 50m Normal Pulling pod/payload-pre-processing-7b98bb678c-qg778 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 50m Normal Pulling pod/payload-processing-7bb9489676-dj76x Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 50m Normal AddedInterface pod/payload-processing-7bb9489676-dj76x Add eth0 [10.133.0.32/23] from ovn-kubernetes 50m Normal Pulled pod/payload-pre-processing-7b98bb678c-qg778 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.544s (2.544s including waiting). Image size: 125353963 bytes. 50m Normal Started pod/payload-pre-processing-7b98bb678c-qg778 Container started 50m Normal Created pod/payload-pre-processing-7b98bb678c-qg778 Container created 50m Normal Created pod/payload-processing-7bb9489676-dj76x Container created 50m Normal Pulled pod/payload-processing-7bb9489676-dj76x Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.883s (2.883s including waiting). Image size: 125353963 bytes. 50m Normal Started pod/payload-processing-7bb9489676-dj76x Container started 49m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz 49m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled up replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 0 to 1 49m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b 49m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 0 to 1 49m Normal AddedLabel gateway/e2e-worker-w0-120fe3 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-120fe3 49m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx 49m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled up replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 0 to 1 49m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m 49m Normal AddedLabel gateway/e2e-worker-w4-5348ca Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-5348ca 49m Normal AddedLabel gateway/e2e-worker-w5-ab1e46 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-ab1e46 49m Normal AddedLabel gateway/e2e-worker-w1-b42aea Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-b42aea 49m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled up replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 0 to 1 49m Normal AddedLabel gateway/e2e-worker-w3-b87733 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-b87733 49m Normal AddedLabel gateway/e2e-worker-w2-11a5b0 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-11a5b0 49m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled up replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 0 to 1 49m Normal AddedLabel gateway/e2e-worker-w6-0ed729 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w6-0ed729 49m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Add eth0 [10.132.0.62/23] from ovn-kubernetes 49m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Add eth0 [10.133.0.36/23] from ovn-kubernetes 49m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k 49m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 49m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Add eth0 [10.134.0.43/23] from ovn-kubernetes 49m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt 49m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Add eth0 [10.133.0.35/23] from ovn-kubernetes 49m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Add eth0 [10.133.0.34/23] from ovn-kubernetes 49m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled up replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 0 to 1 49m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Add eth0 [10.132.0.61/23] from ovn-kubernetes 49m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled up replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 0 to 1 49m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Add eth0 [10.132.0.63/23] from ovn-kubernetes 49m Normal Pulled pod/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 49m Normal Created pod/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd Container created 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w2-11a5b0 Scaled up replica set payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f from 0 to 1 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f Created pod: payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f Error creating: pods "payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-11a5b0: serviceaccount "payload-processing-e2e-worker-w2-11a5b0" not found 49m Normal Started pod/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd Container started 49m Normal Created pod/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd Container created 49m Normal AddedInterface pod/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd Add eth0 [10.133.0.38/23] from ovn-kubernetes 49m Normal Pulled pod/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 49m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd Add eth0 [10.133.0.37/23] from ovn-kubernetes 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w0-120fe3 Scaled up replica set payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f from 0 to 1 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w0-120fe3 Scaled up replica set payload-processing-e2e-worker-w0-120fe3-564ff75dfb from 0 to 1 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f Error creating: pods "payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-120fe3: serviceaccount "payload-processing-e2e-worker-w0-120fe3" not found 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w2-11a5b0 Scaled up replica set payload-processing-e2e-worker-w2-11a5b0-6f4777d64b from 0 to 1 49m Warning FailedCreate replicaset/payload-processing-e2e-worker-w0-120fe3-564ff75dfb Error creating: pods "payload-processing-e2e-worker-w0-120fe3-564ff75dfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-120fe3: serviceaccount "payload-processing-e2e-worker-w0-120fe3" not found 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b Created pod: payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd 49m Warning FailedCreate replicaset/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b Error creating: pods "payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-11a5b0: serviceaccount "payload-processing-e2e-worker-w2-11a5b0" not found 49m Normal Started pod/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd Container started 49m Normal Pulling pod/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w4-5348ca Scaled up replica set payload-processing-e2e-worker-w4-5348ca-87b665cfd from 0 to 1 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9 Created pod: payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx 49m Normal AddedInterface pod/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 Add eth0 [10.132.0.65/23] from ovn-kubernetes 49m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 Add eth0 [10.132.0.64/23] from ovn-kubernetes 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f Created pod: payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9 Error creating: pods "payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-5348ca: serviceaccount "payload-processing-e2e-worker-w4-5348ca" not found 49m Warning FailedCreate replicaset/payload-processing-e2e-worker-w4-5348ca-87b665cfd Error creating: pods "payload-processing-e2e-worker-w4-5348ca-87b665cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-5348ca: serviceaccount "payload-processing-e2e-worker-w4-5348ca" not found 49m Normal Pulling pod/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w4-5348ca-87b665cfd Created pod: payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w4-5348ca Scaled up replica set payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9 from 0 to 1 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w0-120fe3-564ff75dfb Created pod: payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55 Created pod: payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j 49m Normal Pulling pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55 Error creating: pods "payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b42aea: serviceaccount "payload-processing-e2e-worker-w1-b42aea" not found 49m Normal Started pod/payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb Container started 49m Normal Pulling pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Add eth0 [10.132.0.67/23] from ovn-kubernetes 49m Normal Created pod/payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb Container created 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w1-b42aea-5b857c86 Created pod: payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w1-b42aea Scaled up replica set payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55 from 0 to 1 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w1-b42aea Scaled up replica set payload-processing-e2e-worker-w1-b42aea-5b857c86 from 0 to 1 49m Warning FailedCreate replicaset/payload-processing-e2e-worker-w1-b42aea-5b857c86 Error creating: pods "payload-processing-e2e-worker-w1-b42aea-5b857c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b42aea: serviceaccount "payload-processing-e2e-worker-w1-b42aea" not found 49m Normal AddedInterface pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Add eth0 [10.134.0.44/23] from ovn-kubernetes 49m Normal Pulled pod/payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 49m Normal AddedInterface pod/payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb Add eth0 [10.133.0.40/23] from ovn-kubernetes 49m Normal Pulling pod/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx Add eth0 [10.132.0.66/23] from ovn-kubernetes 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w3-b87733-747d96db47 Error creating: pods "payload-pre-processing-e2e-worker-w3-b87733-747d96db47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b87733: serviceaccount "payload-processing-e2e-worker-w3-b87733" not found 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f Error creating: pods "payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-0ed729: serviceaccount "payload-processing-e2e-worker-w6-0ed729" not found 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w6-0ed729 Scaled up replica set payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f from 0 to 1 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w3-b87733 Scaled up replica set payload-processing-e2e-worker-w3-b87733-9c5b7fdd from 0 to 1 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w3-b87733-9c5b7fdd Created pod: payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w6-0ed729 Scaled up replica set payload-processing-e2e-worker-w6-0ed729-d7bdd7f56 from 0 to 1 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w3-b87733 Scaled up replica set payload-pre-processing-e2e-worker-w3-b87733-747d96db47 from 0 to 1 49m Warning FailedCreate replicaset/payload-processing-e2e-worker-w3-b87733-9c5b7fdd Error creating: pods "payload-processing-e2e-worker-w3-b87733-9c5b7fdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b87733: serviceaccount "payload-processing-e2e-worker-w3-b87733" not found 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w3-b87733-747d96db47 Created pod: payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799 Created pod: payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 49m Normal Pulling pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Normal Created pod/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz Container created 49m Normal Pulled pod/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w5-ab1e46 Scaled up replica set payload-processing-e2e-worker-w5-ab1e46-57c8758d5d from 0 to 1 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799 Error creating: pods "payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-ab1e46: serviceaccount "payload-processing-e2e-worker-w5-ab1e46" not found 49m Normal AddedInterface pod/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz Add eth0 [10.133.0.41/23] from ovn-kubernetes 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w5-ab1e46 Scaled up replica set payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799 from 0 to 1 49m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Add eth0 [10.132.0.70/23] from ovn-kubernetes 49m Normal Pulling pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f Created pod: payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56 Created pod: payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d Created pod: payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 49m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Add eth0 [10.132.0.69/23] from ovn-kubernetes 49m Normal Pulling pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Warning FailedCreate replicaset/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56 Error creating: pods "payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-0ed729: serviceaccount "payload-processing-e2e-worker-w6-0ed729" not found 49m Normal Started pod/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz Container started 49m Normal AddedInterface pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Add eth0 [10.132.0.68/23] from ovn-kubernetes 49m Warning FailedCreate replicaset/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d Error creating: pods "payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-ab1e46: serviceaccount "payload-processing-e2e-worker-w5-ab1e46" not found 49m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 Add eth0 [10.133.0.42/23] from ovn-kubernetes 49m Normal Pulling pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 49m Normal AddedInterface pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Add eth0 [10.132.0.71/23] from ovn-kubernetes 49m Normal Pulled pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.592s (2.592s including waiting). Image size: 125353963 bytes. 49m Normal Created pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Container created 49m Normal Started pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Container started 49m Normal Started pod/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 Container started 49m Normal Created pod/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 Container created 49m Normal Pulled pod/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 49m Normal Created pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Container created 49m Normal Pulled pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.583s (2.583s including waiting). Image size: 125353963 bytes. 49m Normal Started pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Container started 49m Normal Started pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Container started 49m Normal Created pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Container created 49m Normal Pulled pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.267s (3.267s including waiting). Image size: 125353963 bytes. 49m Normal Created pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Container created 49m Normal Pulled pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 840ms (840ms including waiting). Image size: 125353963 bytes. 49m Normal Pulled pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.596s (2.596s including waiting). Image size: 125353963 bytes. 49m Normal Started pod/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 Container started 49m Normal Created pod/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 Container created 49m Normal Pulled pod/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.379s (4.379s including waiting). Image size: 125353963 bytes. 49m Normal Started pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Container started 49m Normal Created pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Container created 49m Normal Started pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Container started 49m Normal Started pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Container started 49m Normal Pulled pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.493s (2.493s including waiting). Image size: 125353963 bytes. 49m Normal Created pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Container created 49m Normal Started pod/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx Container started 49m Normal Started pod/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 Container started 49m Normal Created pod/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 Container created 49m Normal Pulled pod/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.725s (5.725s including waiting). Image size: 125353963 bytes. 49m Normal Created pod/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx Container created 49m Normal Pulled pod/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.847s (4.847s including waiting). Image size: 125353963 bytes. 49m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 49m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 49m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Container created 49m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 49m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Container started 49m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 49m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Container started 49m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Container created 49m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Container started 49m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Container created 49m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused... 49m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused 49m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Container started 49m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Container created 49m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused 49m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused... 49m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Container created 49m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Container started 49m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused 49m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 49m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Container started 49m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 49m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 49m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused... 49m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Container created 49m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 49m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 49m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 49m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused 49m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused... 49m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Container started 49m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Container created 49m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused 49m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused... 49m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:43924->10.132.0.61:15021: read: connection reset by peer... 49m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:43924->10.132.0.61:15021: read: connection reset by peer 48m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused 48m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused... 48m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused... 48m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled up replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 1 to 2 48m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Add eth0 [10.132.0.79/23] from ovn-kubernetes 48m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Container started 48m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 48m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Container created 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 48m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused... 48m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused 48m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled up replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 1 to 3 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 48m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd 48m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 1 to 2 48m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 48m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l 48m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 48m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled up replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 1 to 2 48m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Container started 48m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Container created 48m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Add eth0 [10.133.0.50/23] from ovn-kubernetes 48m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Container started 48m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Container started 48m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Container created 48m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Container created 48m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Add eth0 [10.134.0.53/23] from ovn-kubernetes 48m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Add eth0 [10.134.0.52/23] from ovn-kubernetes 48m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Container started 48m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Add eth0 [10.134.0.51/23] from ovn-kubernetes 48m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Container created 47m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused... 47m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused 47m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused... 47m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused 47m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused 47m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused... 47m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused 47m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused... 47m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 47m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled up replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 1 to 2 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 47m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Add eth0 [10.132.0.81/23] from ovn-kubernetes 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 47m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Container started 47m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Container created 47m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled up replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 1 to 2 47m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Add eth0 [10.132.0.80/23] from ovn-kubernetes 47m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled up replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 1 to 2 47m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv 47m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Container started 47m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Container created 47m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Add eth0 [10.134.0.54/23] from ovn-kubernetes 47m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 47m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Container created 47m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Container started 47m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused 47m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused... 47m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused 47m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused... 47m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused 47m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused... 47m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s 47m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Add eth0 [10.133.0.52/23] from ovn-kubernetes 47m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled up replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 2 to 3 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 47m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Container created 47m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Container started 47m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused 47m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused... 47m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb 47m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 47m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled up replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 2 to 4 47m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk 47m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Container started 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 47m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 47m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch 47m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Container started 47m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Container started 47m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Container created 47m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Add eth0 [10.134.0.56/23] from ovn-kubernetes 47m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Container created 47m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Add eth0 [10.134.0.57/23] from ovn-kubernetes 47m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Container created 47m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Container started 47m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled up replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 3 to 5 47m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp 47m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Container started 47m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Container created 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 47m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled up replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 2 to 4 47m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Add eth0 [10.132.0.97/23] from ovn-kubernetes 47m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Container created 47m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Add eth0 [10.133.0.55/23] from ovn-kubernetes 47m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Container started 47m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Container created 47m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Add eth0 [10.133.0.54/23] from ovn-kubernetes 47m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Add eth0 [10.132.0.98/23] from ovn-kubernetes 47m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused 46m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused 46m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 46m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 46m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled up replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 2 to 3 46m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m 46m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled up replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 2 to 4 46m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Container started 46m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Container created 46m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Container started 46m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf 46m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Add eth0 [10.133.0.56/23] from ovn-kubernetes 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 46m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 46m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled up replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 5 to 7 46m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Add eth0 [10.132.0.102/23] from ovn-kubernetes 46m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Container created 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 46m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Add eth0 [10.134.0.58/23] from ovn-kubernetes 46m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Add eth0 [10.134.0.59/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 46m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq 46m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss 46m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Container started 46m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Container started 46m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Container created 46m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Container created 46m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Container started 46m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Container created 46m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Add eth0 [10.134.0.60/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused 46m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused 46m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 46m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 2 to 3 46m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Container created 46m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Container started 46m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Add eth0 [10.134.0.61/23] from ovn-kubernetes 46m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled up replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 3 to 5 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 46m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Container started 46m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Container created 46m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 46m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Add eth0 [10.132.0.105/23] from ovn-kubernetes 46m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 46m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh 46m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Container created 46m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 46m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled up replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 3 to 6 46m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d 46m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Container started 46m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Add eth0 [10.133.0.59/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Container created 46m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Container started 46m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Container created 46m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Container started 46m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Add eth0 [10.134.0.62/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Add eth0 [10.132.0.106/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Container created 46m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Container started 46m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Add eth0 [10.133.0.60/23] from ovn-kubernetes 46m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused 46m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 46m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 46m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Container created 46m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled up replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 4 to 8 46m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 46m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled up replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 7 to 10 46m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 46m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z 46m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Add eth0 [10.134.0.65/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Container created 46m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Add eth0 [10.132.0.108/23] from ovn-kubernetes 46m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Container started 46m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z 46m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Container started 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 46m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Add eth0 [10.132.0.109/23] from ovn-kubernetes 46m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Add eth0 [10.134.0.66/23] from ovn-kubernetes 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 46m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Add eth0 [10.133.0.62/23] from ovn-kubernetes 46m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Add eth0 [10.134.0.67/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Add eth0 [10.133.0.64/23] from ovn-kubernetes 46m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Container started 46m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Container created 46m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Container started 46m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 (combined from similar events): Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p 46m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm 46m Normal SuccessfulCreate replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Created pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q 46m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Container created 46m Normal Started pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Container started 46m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled up replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 4 to 7 46m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Add eth0 [10.132.0.107/23] from ovn-kubernetes 46m Normal Created pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Container created 46m Normal Pulled pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Container created 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 46m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Container started 46m Normal AddedInterface pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Add eth0 [10.133.0.63/23] from ovn-kubernetes 46m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f 46m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw 46m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh 46m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Container created 46m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Container started 46m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Container created 46m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Add eth0 [10.133.0.65/23] from ovn-kubernetes 46m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Container started 46m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Container started 46m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Container created 46m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Container started 46m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Container created 46m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-vk8mm 46m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 2; reason: cpu resource utilization (percentage of request) above target 46m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2 46m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-vk8mm Add eth0 [10.132.0.110/23] from ovn-kubernetes 46m Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-vk8mm Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused 46m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused 46m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused 46m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused 46m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused 46m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-vk8mm Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.511s (5.511s including waiting). Image size: 185476477 bytes. 46m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-vk8mm Container started 46m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-vk8mm Container created 46m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl 46m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 3 to 4 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 46m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz 46m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl 46m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled up replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 8 to 9 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 46m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled up replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 4 to 5 46m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 9; reason: All metrics below target 46m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Container created 46m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Add eth0 [10.133.0.67/23] from ovn-kubernetes 46m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Container started 46m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Container created 46m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Add eth0 [10.134.0.69/23] from ovn-kubernetes 46m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Container created 46m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Container started 46m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Add eth0 [10.134.0.70/23] from ovn-kubernetes 46m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Container started 45m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused 45m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused... 45m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused 45m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused... 45m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Add eth0 [10.132.0.112/23] from ovn-kubernetes 45m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv 45m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Add eth0 [10.134.0.72/23] from ovn-kubernetes 45m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 45m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm 45m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj 45m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w 45m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 45m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 45m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled up replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 5 to 8 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 45m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled up replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 5 to 8 45m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Add eth0 [10.133.0.69/23] from ovn-kubernetes 45m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Container started 45m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Add eth0 [10.133.0.70/23] from ovn-kubernetes 45m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Container started 45m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Container created 45m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Add eth0 [10.134.0.73/23] from ovn-kubernetes 45m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Container created 45m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Container started 45m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Container started 45m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Container started 45m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Container started 45m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Container created 45m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Container created 45m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Container created 45m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Add eth0 [10.132.0.113/23] from ovn-kubernetes 45m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Container created 45m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused 45m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused... 45m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused 45m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused... 45m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused 45m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused... 45m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 45m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled up replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 9 to 10 45m Normal SuccessfulCreate replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc (combined from similar events): Created pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx 45m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 45m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 45m Normal Created pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Container created 45m Normal AddedInterface pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Add eth0 [10.134.0.74/23] from ovn-kubernetes 45m Normal Pulled pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Started pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Container started 45m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused 45m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused... 45m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 4 to 5 45m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Container created 45m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l 45m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Container started 45m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 45m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled up replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 6 to 10 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 45m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk 45m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Add eth0 [10.132.0.118/23] from ovn-kubernetes 45m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd 45m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal SuccessfulCreate replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf (combined from similar events): Created pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 45m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Add eth0 [10.133.0.72/23] from ovn-kubernetes 45m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Container started 45m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Add eth0 [10.134.0.75/23] from ovn-kubernetes 45m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Container created 45m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Container started 45m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Container created 45m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Container started 45m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Container created 45m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Add eth0 [10.133.0.73/23] from ovn-kubernetes 45m Normal Started pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Container started 45m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Pulled pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Created pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Container created 45m Normal AddedInterface pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Add eth0 [10.132.0.119/23] from ovn-kubernetes 45m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused... 45m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Startup probe failed: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused 45m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Startup probe error: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused... 45m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled up replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 8 to 10 45m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc (combined from similar events): Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks 45m Normal SuccessfulCreate replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Created pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 45m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Add eth0 [10.134.0.76/23] from ovn-kubernetes 45m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Container created 44m Normal Created pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Container created 44m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Container started 44m Normal Pulled pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Add eth0 [10.133.0.74/23] from ovn-kubernetes 44m Normal Started pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Container started 44m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused 44m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused... 44m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused... 44m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused 44m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 44m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 44m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 5 to 7 44m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s 44m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Add eth0 [10.132.0.135/23] from ovn-kubernetes 44m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Add eth0 [10.133.0.76/23] from ovn-kubernetes 44m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Add eth0 [10.134.0.77/23] from ovn-kubernetes 44m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 44m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled up replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 8 to 10 44m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled up replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 7 to 10 44m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq 44m Normal SuccessfulCreate replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 (combined from similar events): Created pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s 44m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Add eth0 [10.133.0.75/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll 44m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg 44m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 (combined from similar events): Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc 44m Normal SuccessfulCreate replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Created pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m 44m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Add eth0 [10.134.0.78/23] from ovn-kubernetes 44m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Pulled pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Add eth0 [10.132.0.136/23] from ovn-kubernetes 44m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Container created 44m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Container started 44m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Container started 44m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Container created 44m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Container created 44m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Container started 44m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Container created 44m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Container started 44m Normal Created pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Container created 44m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Container created 44m Normal Started pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Container started 44m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Readiness probe failed: timeout: failed to connect service "10.132.0.70:50052" within 1s: context deadline exceeded 44m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Container started 44m Normal AddedInterface pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Add eth0 [10.132.0.137/23] from ovn-kubernetes 44m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Normal Pulled pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Normal Started pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Container started 44m Normal Created pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Container created 44m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 44m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 44m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused 44m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused... 44m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused... 44m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused 44m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused 44m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused 44m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused 44m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 7 to 9 44m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused... 44m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp 44m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused... 44m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 9; reason: cpu resource utilization (percentage of request) above target 44m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl 44m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused... 44m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused 44m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Add eth0 [10.133.0.77/23] from ovn-kubernetes 44m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused... 44m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Container created 44m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Container started 44m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Add eth0 [10.134.0.79/23] from ovn-kubernetes 44m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Container created 44m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Container started 44m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused... 44m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused 44m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused 44m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused... 44m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused... 44m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused 44m Normal ScalingReplicaSet deployment/e2e-ait-8fdab3c3-openshift-default Scaled up replica set e2e-ait-8fdab3c3-openshift-default-74d6465cf7 from 0 to 1 44m Normal AddedInterface pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Add eth0 [10.134.0.82/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/e2e-ait-8fdab3c3-openshift-default-74d6465cf7 Created pod: e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq 44m Normal AddedLabel gateway/e2e-ait-8fdab3c3 Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8fdab3c3 44m Normal Pulled pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Created pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Container created 44m Normal Started pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Container started 44m Normal SuccessfulCreate replicaset/e2e-ait-ea700cd3-openshift-default-5557655bb7 Created pod: e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq 44m Normal AddedLabel gateway/e2e-ait-ea700cd3 Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ea700cd3 44m Normal ScalingReplicaSet deployment/e2e-ait-ea700cd3-openshift-default Scaled up replica set e2e-ait-ea700cd3-openshift-default-5557655bb7 from 0 to 1 44m Normal ScalingReplicaSet deployment/e2e-derive-1cca2dba-openshift-default Scaled up replica set e2e-derive-1cca2dba-openshift-default-7fbd7c797c from 0 to 1 44m Normal SuccessfulCreate replicaset/e2e-derive-1cca2dba-openshift-default-7fbd7c797c Created pod: e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b 44m Normal AddedLabel gateway/e2e-derive-1cca2dba Added label istio.io/rev=openshift-gateway to gateway e2e-derive-1cca2dba 44m Normal Created pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Container created 44m Normal Pulled pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Add eth0 [10.133.0.78/23] from ovn-kubernetes 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-8fdab3c3 Scaled up replica set payload-processing-e2e-ait-8fdab3c3-59db6567f4 from 0 to 1 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-8fdab3c3 Scaled up replica set payload-pre-processing-e2e-ait-8fdab3c3-f7f599547 from 0 to 1 44m Normal Started pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Container started 44m Normal Created pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Container created 44m Normal Pulled pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Add eth0 [10.132.0.147/23] from ovn-kubernetes 44m Normal Started pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Container started 44m Normal Pulled pod/payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq Add eth0 [10.132.0.148/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-8fdab3c3-59db6567f4 Created pod: payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq 44m Normal Created pod/payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq Container created 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547 Created pod: payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k 44m Warning FailedCreate replicaset/payload-processing-e2e-ait-8fdab3c3-59db6567f4 Error creating: pods "payload-processing-e2e-ait-8fdab3c3-59db6567f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8fdab3c3: serviceaccount "payload-processing-e2e-ait-8fdab3c3" not found 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547 Error creating: pods "payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8fdab3c3: serviceaccount "payload-processing-e2e-ait-8fdab3c3" not found 44m Normal Pulled pod/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Normal Created pod/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k Container created 44m Normal Started pod/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k Container started 44m Normal Started pod/payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq Container started 44m Normal AddedInterface pod/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k Add eth0 [10.133.0.79/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f Created pod: payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-ea700cd3 Scaled up replica set payload-processing-e2e-ait-ea700cd3-5df695b668 from 0 to 1 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f Error creating: pods "payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ea700cd3: serviceaccount "payload-processing-e2e-ait-ea700cd3" not found 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-ea700cd3 Scaled up replica set payload-pre-processing-e2e-ait-ea700cd3-8979bd89f from 0 to 1 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-ea700cd3-5df695b668 Created pod: payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv 44m Warning FailedCreate replicaset/payload-processing-e2e-ait-ea700cd3-5df695b668 Error creating: pods "payload-processing-e2e-ait-ea700cd3-5df695b668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ea700cd3: serviceaccount "payload-processing-e2e-ait-ea700cd3" not found 44m Warning FailedCreate replicaset/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7 Error creating: pods "payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-1cca2dba: serviceaccount "payload-processing-e2e-derive-1cca2dba" not found 44m Warning FailedCreate replicaset/payload-processing-e2e-derive-1cca2dba-545c59947d Error creating: pods "payload-processing-e2e-derive-1cca2dba-545c59947d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-1cca2dba: serviceaccount "payload-processing-e2e-derive-1cca2dba" not found 44m Normal Created pod/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv Container created 44m Normal ScalingReplicaSet deployment/payload-processing-e2e-derive-1cca2dba Scaled up replica set payload-processing-e2e-derive-1cca2dba-545c59947d from 0 to 1 44m Normal Started pod/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt Container started 44m Normal SuccessfulCreate replicaset/payload-processing-e2e-derive-1cca2dba-545c59947d Created pod: payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r 44m Normal AddedInterface pod/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv Add eth0 [10.132.0.150/23] from ovn-kubernetes 44m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-derive-1cca2dba Scaled up replica set payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7 from 0 to 1 44m Normal Created pod/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt Container created 44m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7 Created pod: payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 44m Normal Started pod/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv Container started 44m Normal Pulled pod/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt Add eth0 [10.132.0.151/23] from ovn-kubernetes 44m Normal Pulled pod/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Normal Created pod/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 Container created 44m Normal Created pod/payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r Container created 44m Normal Pulled pod/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 Add eth0 [10.133.0.80/23] from ovn-kubernetes 44m Normal Started pod/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 Container started 44m Normal Started pod/payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r Container started 44m Normal AddedInterface pod/payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r Add eth0 [10.133.0.81/23] from ovn-kubernetes 44m Normal Pulled pod/payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-derive-1cca2dba-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-derive-1cca2dba-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 43m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 43m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 43m Warning Unhealthy pod/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv Readiness probe failed: timeout: failed to connect service "10.132.0.150:50052" within 1s: context deadline exceeded 43m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 43m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-8fdab3c3-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-8fdab3c3-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-ea700cd3-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-ea700cd3-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-derive-1cca2dba-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-derive-1cca2dba-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 43m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled up replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 9 to 10 43m Normal SuccessfulCreate replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 (combined from similar events): Created pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 43m Normal AddedInterface pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Add eth0 [10.132.0.155/23] from ovn-kubernetes 43m Normal Started pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Container started 43m Normal Pulled pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal Created pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Container created 43m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-qrs7z 43m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-lfrxk 43m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 4 43m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 4; reason: cpu resource utilization (percentage of request) above target 43m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 43m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Add eth0 [10.132.0.159/23] from ovn-kubernetes 43m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Container created 43m Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 43m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Add eth0 [10.134.0.85/23] from ovn-kubernetes 43m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Container started 43m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Readiness probe failed: HTTP probe failed with statuscode: 503 43m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Readiness probe error: HTTP probe failed with statuscode: 503... 43m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Container started 43m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.153s (3.153s including waiting). Image size: 185476477 bytes. 43m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Container created 43m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused... 43m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused 43m Normal Killing pod/payload-processing-e2e-ait-8fdab3c3-59db6567f4-psqhq Stopping container payload-processing 43m Normal Killing pod/payload-pre-processing-e2e-ait-8fdab3c3-f7f599547-ttj2k Stopping container payload-pre-processing 43m Normal Killing pod/payload-processing-e2e-derive-1cca2dba-545c59947d-wqr4r Stopping container payload-processing 43m Normal Killing pod/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 Stopping container payload-pre-processing 43m Normal Killing pod/payload-processing-e2e-ait-ea700cd3-5df695b668-mfrtv Stopping container payload-processing 43m Normal Killing pod/payload-pre-processing-e2e-ait-ea700cd3-8979bd89f-g62lt Stopping container payload-pre-processing 43m Warning Unhealthy pod/payload-pre-processing-e2e-derive-1cca2dba-77444d6cb7-47x79 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 43m Normal Killing pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Stopping container istio-proxy 43m Normal AddedLabel gateway/e2e-migrate-c13f7966-gw Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c13f7966-gw 43m Normal SuccessfulCreate replicaset/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c Created pod: e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm 43m Normal ScalingReplicaSet deployment/e2e-migrate-c13f7966-gw-openshift-default Scaled up replica set e2e-migrate-c13f7966-gw-openshift-default-7b8777989c from 0 to 1 43m Warning Unhealthy pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Readiness probe failed: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 43m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Readiness probe error: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 43m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Readiness probe failed: Get "http://10.132.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 43m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Readiness probe error: Get "http://10.132.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 43m Normal Pulled pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal AddedInterface pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Add eth0 [10.133.0.83/23] from ovn-kubernetes 43m Normal AddedLabel gateway/e2e-shared-a-w1-d81d18 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-d81d18 43m Normal Created pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Container created 43m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-d81d18-openshift-default-66479b569c Created pod: e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq 43m Normal Started pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Container started 43m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-d81d18-openshift-default Scaled up replica set e2e-shared-a-w1-d81d18-openshift-default-66479b569c from 0 to 1 43m Normal AddedInterface pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Add eth0 [10.133.0.84/23] from ovn-kubernetes 43m Warning Unhealthy pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Readiness probe failed: HTTP probe failed with statuscode: 503 43m Normal Killing pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Stopping container istio-proxy 43m Warning ProbeError pod/e2e-ait-8fdab3c3-openshift-default-74d6465cf7-hjkgq Readiness probe error: HTTP probe failed with statuscode: 503... 43m Normal Killing pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Stopping container istio-proxy 43m Warning FailedToUpdateEndpointSlices service/e2e-ait-ea700cd3-openshift-default Error updating Endpoint Slices for Service openshift-ingress/e2e-ait-ea700cd3-openshift-default: failed to delete e2e-ait-ea700cd3-openshift-default-l5q8f EndpointSlice for Service openshift-ingress/e2e-ait-ea700cd3-openshift-default: endpointslices.discovery.k8s.io "e2e-ait-ea700cd3-openshift-default-l5q8f" not found 43m Normal ScalingReplicaSet deployment/e2e-ait-323cb6ed-openshift-default Scaled up replica set e2e-ait-323cb6ed-openshift-default-7959d7f96f from 0 to 1 43m Normal SuccessfulCreate replicaset/e2e-ait-323cb6ed-openshift-default-7959d7f96f Created pod: e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx 43m Normal AddedLabel gateway/e2e-ait-323cb6ed Added label istio.io/rev=openshift-gateway to gateway e2e-ait-323cb6ed 43m Normal ScalingReplicaSet deployment/payload-processing-e2e-migrate-c13f7966 Scaled up replica set payload-processing-e2e-migrate-c13f7966-8449f66b8b from 0 to 1 43m Warning FailedCreate replicaset/payload-processing-e2e-migrate-c13f7966-8449f66b8b Error creating: pods "payload-processing-e2e-migrate-c13f7966-8449f66b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c13f7966: serviceaccount "payload-processing-e2e-migrate-c13f7966" not found 43m Normal SuccessfulCreate replicaset/payload-processing-e2e-migrate-c13f7966-8449f66b8b Created pod: payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx 43m Warning FailedCreate replicaset/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79 Error creating: pods "payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c13f7966: serviceaccount "payload-processing-e2e-migrate-c13f7966" not found 43m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79 Created pod: payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 43m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-migrate-c13f7966 Scaled up replica set payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79 from 0 to 1 43m Normal Pulled pod/payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 43m Normal Pulled pod/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 43m Normal AddedInterface pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Add eth0 [10.133.0.85/23] from ovn-kubernetes 43m Normal Started pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Container started 43m Normal Created pod/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 Container created 43m Normal Started pod/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 Container started 43m Normal Started pod/payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx Container started 43m Normal AddedInterface pod/payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx Add eth0 [10.133.0.87/23] from ovn-kubernetes 43m Normal Created pod/payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx Container created 43m Normal Created pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Container created 43m Normal Pulled pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal AddedInterface pod/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 Add eth0 [10.133.0.86/23] from ovn-kubernetes 43m Warning ProbeError pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 43m Warning Unhealthy pod/e2e-ait-ea700cd3-openshift-default-5557655bb7-pdbpq Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 43m Warning ProbeError pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Readiness probe error: Get "http://10.132.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 43m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w1-d81d18 Scaled up replica set payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858 from 0 to 1 43m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff Error creating: pods "payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-d81d18: serviceaccount "payload-processing-e2e-shared-a-w1-d81d18" not found 43m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858 Error creating: pods "payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-d81d18: serviceaccount "payload-processing-e2e-shared-a-w1-d81d18" not found 43m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff Created pod: payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh 43m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w1-d81d18 Scaled up replica set payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff from 0 to 1 43m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858 Created pod: payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq 43m Warning Unhealthy pod/e2e-derive-1cca2dba-openshift-default-7fbd7c797c-c5v2b Readiness probe failed: Get "http://10.132.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 43m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 43m Normal Created pod/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh Container created 43m Normal Pulled pod/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 43m Normal Started pod/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh Container started 43m Normal Created pod/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq Container created 43m Normal AddedInterface pod/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq Add eth0 [10.133.0.88/23] from ovn-kubernetes 43m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh Add eth0 [10.133.0.89/23] from ovn-kubernetes 43m Normal Started pod/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq Container started 43m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c Error creating: pods "payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-323cb6ed: serviceaccount "payload-processing-e2e-ait-323cb6ed" not found 43m Warning FailedCreate replicaset/payload-processing-e2e-ait-323cb6ed-85f4995966 Error creating: pods "payload-processing-e2e-ait-323cb6ed-85f4995966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-323cb6ed: serviceaccount "payload-processing-e2e-ait-323cb6ed" not found 43m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-323cb6ed-85f4995966 Created pod: payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm 43m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-323cb6ed Scaled up replica set payload-processing-e2e-ait-323cb6ed-85f4995966 from 0 to 1 43m Normal AddedInterface pod/payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm Add eth0 [10.132.0.160/23] from ovn-kubernetes 43m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-323cb6ed Scaled up replica set payload-pre-processing-e2e-ait-323cb6ed-659647cd6c from 0 to 1 43m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c Created pod: payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm 43m Normal AddedInterface pod/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm Add eth0 [10.133.0.90/23] from ovn-kubernetes 43m Normal Started pod/payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm Container started 43m Normal Created pod/payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm Container created 43m Normal Pulled pod/payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 43m Normal Started pod/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm Container started 43m Normal Created pod/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm Container created 43m Normal Pulled pod/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-migrate-c13f7966-gw-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-migrate-c13f7966-gw-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f Created pod: e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc 42m Normal ScalingReplicaSet deployment/e2e-shared-b-w1-944e83-openshift-default Scaled up replica set e2e-shared-b-w1-944e83-openshift-default-857fc7f84f from 0 to 1 42m Normal AddedLabel gateway/e2e-shared-b-w1-944e83 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-944e83 42m Normal AddedInterface pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Add eth0 [10.132.0.162/23] from ovn-kubernetes 42m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w1-944e83 Scaled up replica set payload-processing-e2e-shared-b-w1-944e83-795689f8b from 0 to 1 42m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w1-944e83-795689f8b Error creating: pods "payload-processing-e2e-shared-b-w1-944e83-795689f8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-944e83: serviceaccount "payload-processing-e2e-shared-b-w1-944e83" not found 42m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767 Error creating: pods "payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-944e83: serviceaccount "payload-processing-e2e-shared-b-w1-944e83" not found 42m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w1-944e83 Scaled up replica set payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767 from 0 to 1 42m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767 Created pod: payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq 42m Normal Pulled pod/payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph Add eth0 [10.133.0.93/23] from ovn-kubernetes 42m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w1-944e83-795689f8b Created pod: payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph 42m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq Add eth0 [10.132.0.164/23] from ovn-kubernetes 42m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal Created pod/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq Container created 42m Normal Started pod/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq Container started 42m Normal Killing pod/payload-processing-e2e-migrate-c13f7966-8449f66b8b-j9qlx Stopping container payload-processing 42m Normal Killing pod/payload-pre-processing-e2e-migrate-c13f7966-5bb7cc5f79-cbvh2 Stopping container payload-pre-processing 42m Normal Started pod/payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph Container started 42m Normal Created pod/payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph Container created 42m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-323cb6ed-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-323cb6ed-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-migrate-c13f7966-gw-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 42m Normal Killing pod/payload-processing-e2e-ait-323cb6ed-85f4995966-7v5hm Stopping container payload-processing 42m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-migrate-c13f7966-gw-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 42m Normal Killing pod/payload-pre-processing-e2e-ait-323cb6ed-659647cd6c-2xlrm Stopping container payload-pre-processing 42m Normal Killing pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Stopping container istio-proxy 42m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-d81d18-openshift-default-66479b569c Created pod: e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr 42m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-d81d18-openshift-default-66479b569c Created pod: e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-d81d18-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 42m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-d81d18-openshift-default Scaled up replica set e2e-shared-a-w1-d81d18-openshift-default-66479b569c from 1 to 4 42m Normal Killing pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Stopping container istio-proxy 42m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-d81d18-openshift-default-66479b569c Created pod: e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp 42m Normal Created pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Container created 42m Normal Started pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Container started 42m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk 42m Normal ScalingReplicaSet deployment/e2e-shared-a-w6-ee2323-openshift-default Scaled up replica set e2e-shared-a-w6-ee2323-openshift-default-855486c599 from 0 to 1 42m Normal AddedLabel gateway/e2e-shared-a-w6-ee2323 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w6-ee2323 42m Normal Started pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Container started 42m Normal Started pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Container started 42m Normal AddedInterface pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Add eth0 [10.134.0.88/23] from ovn-kubernetes 42m Normal Pulled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal Pulled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Add eth0 [10.133.0.94/23] from ovn-kubernetes 42m Normal Created pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Container created 42m Normal Pulled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Add eth0 [10.132.0.166/23] from ovn-kubernetes 42m Normal Created pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Container created 42m Warning ProbeError pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Readiness probe error: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 42m Warning Unhealthy pod/e2e-migrate-c13f7966-gw-openshift-default-7b8777989c-ndwkm Readiness probe failed: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 42m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Add eth0 [10.133.0.95/23] from ovn-kubernetes 42m Warning Unhealthy pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 42m Warning ProbeError pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 42m Warning Unhealthy pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused 42m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f Error creating: pods "payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w6-ee2323: serviceaccount "payload-processing-e2e-shared-a-w6-ee2323" not found 42m Warning ProbeError pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused... 42m Warning Unhealthy pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused 42m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w6-ee2323 Scaled up replica set payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d from 0 to 1 42m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d Created pod: payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt 42m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d Error creating: pods "payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w6-ee2323: serviceaccount "payload-processing-e2e-shared-a-w6-ee2323" not found 42m Warning ProbeError pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused... 42m Warning ProbeError pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Readiness probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 42m Warning Unhealthy pod/e2e-ait-323cb6ed-openshift-default-7959d7f96f-rk7lx Readiness probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 42m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w6-ee2323 Scaled up replica set payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f from 0 to 1 42m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f Created pod: payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 42m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 Add eth0 [10.133.0.97/23] from ovn-kubernetes 42m Normal Created pod/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 Container created 42m Normal Started pod/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 Container started 42m Warning Unhealthy pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused 42m Normal Started pod/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt Container started 42m Warning ProbeError pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused... 42m Normal AddedInterface pod/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt Add eth0 [10.133.0.96/23] from ovn-kubernetes 42m Normal Pulled pod/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal Created pod/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt Container created 42m Normal Created pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Container created 42m Normal Pulled pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 42m Normal Started pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Container started 42m Normal AddedLabel gateway/e2e-mt-acd98d21 Added label istio.io/rev=openshift-gateway to gateway e2e-mt-acd98d21 42m Normal SuccessfulCreate replicaset/e2e-mt-acd98d21-openshift-default-7ffbccb87c Created pod: e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 42m Normal ScalingReplicaSet deployment/e2e-mt-acd98d21-openshift-default Scaled up replica set e2e-mt-acd98d21-openshift-default-7ffbccb87c from 0 to 1 42m Normal AddedInterface pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Add eth0 [10.133.0.98/23] from ovn-kubernetes 42m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w1-d81d18-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w1-d81d18-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-acd98d21-555b65457f Created pod: payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx 42m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-acd98d21-555b65457f Error creating: pods "payload-pre-processing-e2e-mt-acd98d21-555b65457f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-acd98d21: serviceaccount "payload-processing-e2e-mt-acd98d21" not found 42m Warning FailedCreate replicaset/payload-processing-e2e-mt-acd98d21-784b68d996 Error creating: pods "payload-processing-e2e-mt-acd98d21-784b68d996-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-acd98d21: serviceaccount "payload-processing-e2e-mt-acd98d21" not found 42m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-acd98d21 Scaled up replica set payload-pre-processing-e2e-mt-acd98d21-555b65457f from 0 to 1 42m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-acd98d21-784b68d996 Created pod: payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk 42m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-acd98d21 Scaled up replica set payload-processing-e2e-mt-acd98d21-784b68d996 from 0 to 1 42m Normal AddedInterface pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx Add eth0 [10.133.0.101/23] from ovn-kubernetes 42m Normal Pulled pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk Add eth0 [10.133.0.100/23] from ovn-kubernetes 42m Warning Unhealthy pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused 42m Warning ProbeError pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused... 42m Normal Started pod/payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk Container started 42m Normal Started pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx Container started 42m Normal Created pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx Container created 42m Normal Pulled pod/payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal Created pod/payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk Container created 41m Normal AddedLabel gateway/e2e-shared-b-w6-0ffd89 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w6-0ffd89 41m Normal ScalingReplicaSet deployment/e2e-shared-b-w6-0ffd89-openshift-default Scaled up replica set e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5 from 0 to 1 41m Normal SuccessfulCreate replicaset/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5 Created pod: e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v 41m Normal AddedInterface pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Add eth0 [10.132.0.167/23] from ovn-kubernetes 41m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w1-d81d18-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 41m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w1-d81d18-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 41m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d Error creating: pods "payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w6-0ffd89: serviceaccount "payload-processing-e2e-shared-b-w6-0ffd89" not found 41m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt Add eth0 [10.133.0.102/23] from ovn-kubernetes 41m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w6-0ffd89 Scaled up replica set payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d from 0 to 1 41m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w6-0ffd89 Scaled up replica set payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9 from 0 to 1 41m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d Created pod: payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 41m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9 Created pod: payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt 41m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9 Error creating: pods "payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w6-0ffd89: serviceaccount "payload-processing-e2e-shared-b-w6-0ffd89" not found 41m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 41m Normal Started pod/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 Container started 41m Normal Started pod/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt Container started 41m Normal AddedInterface pod/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 Add eth0 [10.132.0.169/23] from ovn-kubernetes 41m Normal Pulled pod/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 41m Normal Created pod/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 Container created 41m Normal Created pod/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt Container created 41m Normal Started pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Container started 41m Normal Created pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Container created 41m Normal Pulled pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w1-944e83-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 41m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w1-944e83-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 41m Warning Unhealthy pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused 41m Warning ProbeError pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused... 41m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-acd98d21-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 41m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-acd98d21-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 41m Normal SuccessfulCreate replicaset/e2e-api-a-d441dd-openshift-default-64bfb6d74c Created pod: e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 41m Normal AddedLabel gateway/e2e-api-a-d441dd Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d441dd 41m Normal ScalingReplicaSet deployment/e2e-api-a-d441dd-openshift-default Scaled up replica set e2e-api-a-d441dd-openshift-default-64bfb6d74c from 0 to 1 41m Normal AddedInterface pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Add eth0 [10.133.0.104/23] from ovn-kubernetes 41m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-d441dd Scaled up replica set payload-pre-processing-e2e-api-a-d441dd-64db594499 from 0 to 1 41m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-d441dd-6cdf67d9b Created pod: payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp 41m Warning FailedCreate replicaset/payload-processing-e2e-api-a-d441dd-6cdf67d9b Error creating: pods "payload-processing-e2e-api-a-d441dd-6cdf67d9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d441dd: serviceaccount "payload-processing-e2e-api-a-d441dd" not found 41m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-d441dd Scaled up replica set payload-processing-e2e-api-a-d441dd-6cdf67d9b from 0 to 1 41m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-d441dd-64db594499 Error creating: pods "payload-pre-processing-e2e-api-a-d441dd-64db594499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d441dd: serviceaccount "payload-processing-e2e-api-a-d441dd" not found 41m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-d441dd-64db594499 Created pod: payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz 41m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz Add eth0 [10.132.0.170/23] from ovn-kubernetes 41m Normal Pulled pod/payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 41m Normal Started pod/payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp Container started 41m Normal Pulled pod/payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 41m Normal Created pod/payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp Container created 41m Normal AddedInterface pod/payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp Add eth0 [10.132.0.171/23] from ovn-kubernetes 41m Normal Created pod/payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz Container created 41m Normal Started pod/payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz Container started 41m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w1-944e83-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 41m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w1-944e83-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 41m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w6-0ffd89-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 41m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w6-0ffd89-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 41m Normal Started pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Container started 41m Normal Started pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Container started 41m Normal Created pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Container created 41m Normal Pulled pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Pulled pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Created pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Container created 41m Warning Unhealthy pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused 41m Warning ProbeError pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused... 41m Warning Unhealthy pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused 41m Warning ProbeError pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused... 41m Normal SuccessfulCreate replicaset/e2e-api-a-1962f9-openshift-default-56464595f Created pod: e2e-api-a-1962f9-openshift-default-56464595f-d2j7d 41m Normal AddedLabel gateway/e2e-api-a-1962f9 Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1962f9 41m Normal ScalingReplicaSet deployment/e2e-api-a-1962f9-openshift-default Scaled up replica set e2e-api-a-1962f9-openshift-default-56464595f from 0 to 1 41m Normal AddedInterface pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Add eth0 [10.132.0.172/23] from ovn-kubernetes 40m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-1962f9 Scaled up replica set payload-processing-e2e-api-a-1962f9-77fcbfdbf6 from 0 to 1 40m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9 Created pod: payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 40m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-1962f9 Scaled up replica set payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9 from 0 to 1 40m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9 Error creating: pods "payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1962f9: serviceaccount "payload-processing-e2e-api-a-1962f9" not found 40m Warning FailedCreate replicaset/payload-processing-e2e-api-a-1962f9-77fcbfdbf6 Error creating: pods "payload-processing-e2e-api-a-1962f9-77fcbfdbf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1962f9: serviceaccount "payload-processing-e2e-api-a-1962f9" not found 40m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-1962f9-77fcbfdbf6 Created pod: payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 40m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 Add eth0 [10.133.0.106/23] from ovn-kubernetes 40m Normal Pulled pod/payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal Created pod/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 Container created 40m Normal Pulled pod/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal Started pod/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 Container started 40m Normal Started pod/payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 Container started 40m Normal Created pod/payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 Container created 40m Normal AddedInterface pod/payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 Add eth0 [10.132.0.173/23] from ovn-kubernetes 40m Normal ScalingReplicaSet deployment/e2e-api-b-b9dc48-openshift-default Scaled up replica set e2e-api-b-b9dc48-openshift-default-75564dbdc5 from 0 to 1 40m Normal AddedLabel gateway/e2e-shared-a-w0-cad531 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-cad531 40m Normal SuccessfulCreate replicaset/e2e-api-b-b9dc48-openshift-default-75564dbdc5 Created pod: e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc 40m Normal AddedLabel gateway/e2e-api-b-b9dc48 Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b9dc48 40m Normal AddedInterface pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Add eth0 [10.133.0.107/23] from ovn-kubernetes 40m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p 40m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled up replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 0 to 1 40m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Add eth0 [10.132.0.174/23] from ovn-kubernetes 40m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487 Created pod: payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb 40m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d Error creating: pods "payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-cad531: serviceaccount "payload-processing-e2e-shared-a-w0-cad531" not found 40m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d Created pod: payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p 40m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w0-cad531 Scaled up replica set payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d from 0 to 1 40m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487 Error creating: pods "payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-cad531: serviceaccount "payload-processing-e2e-shared-a-w0-cad531" not found 40m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w0-cad531 Scaled up replica set payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487 from 0 to 1 40m Normal AddedInterface pod/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p Add eth0 [10.132.0.176/23] from ovn-kubernetes 40m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659 Error creating: pods "payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9dc48: serviceaccount "payload-processing-e2e-api-b-b9dc48" not found 40m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659 Created pod: payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w 40m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-b9dc48 Scaled up replica set payload-processing-e2e-api-b-b9dc48-9d6cf9dd8 from 0 to 1 40m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8 Created pod: payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd 40m Warning FailedCreate replicaset/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8 Error creating: pods "payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9dc48: serviceaccount "payload-processing-e2e-api-b-b9dc48" not found 40m Normal Started pod/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p Container started 40m Normal Created pod/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p Container created 40m Normal Pulled pod/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal Started pod/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb Container started 40m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-b9dc48 Scaled up replica set payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659 from 0 to 1 40m Normal Created pod/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb Container created 40m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb Add eth0 [10.132.0.175/23] from ovn-kubernetes 40m Normal Started pod/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w Container started 40m Normal Created pod/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w Container created 40m Normal AddedInterface pod/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd Add eth0 [10.132.0.177/23] from ovn-kubernetes 40m Normal Pulled pod/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal Created pod/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd Container created 40m Normal Started pod/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd Container started 40m Normal Pulled pod/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w Add eth0 [10.133.0.108/23] from ovn-kubernetes 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w6-0ffd89-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w6-0ffd89-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-acd98d21-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-acd98d21-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Normal Started pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Container started 40m Normal Created pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Container created 40m Normal Pulled pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Warning Unhealthy pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused 40m Warning ProbeError pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused... 40m Normal ScalingReplicaSet deployment/e2e-mt-acd98d21-openshift-default Scaled up replica set e2e-mt-acd98d21-openshift-default-7ffbccb87c from 1 to 2 40m Normal SuccessfulCreate replicaset/e2e-mt-acd98d21-openshift-default-7ffbccb87c Created pod: e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-mt-acd98d21-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 40m Normal Created pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Container created 40m Normal Started pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Container started 40m Normal ScalingReplicaSet deployment/e2e-api-b-cd7f5c-openshift-default Scaled up replica set e2e-api-b-cd7f5c-openshift-default-f7d549ddc from 0 to 1 40m Normal SuccessfulCreate replicaset/e2e-api-b-cd7f5c-openshift-default-f7d549ddc Created pod: e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j 40m Normal Pulled pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Normal AddedLabel gateway/e2e-api-b-cd7f5c Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cd7f5c 40m Normal AddedInterface pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Add eth0 [10.132.0.178/23] from ovn-kubernetes 40m Normal AddedInterface pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Add eth0 [10.133.0.109/23] from ovn-kubernetes 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-d441dd-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-d441dd-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 40m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55 Error creating: pods "payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cd7f5c: serviceaccount "payload-processing-e2e-api-b-cd7f5c" not found 40m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-cd7f5c Scaled up replica set payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55 from 0 to 1 40m Warning FailedCreate replicaset/payload-processing-e2e-api-b-cd7f5c-57976b7948 Error creating: pods "payload-processing-e2e-api-b-cd7f5c-57976b7948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cd7f5c: serviceaccount "payload-processing-e2e-api-b-cd7f5c" not found 40m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55 Created pod: payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr 40m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-cd7f5c Scaled up replica set payload-processing-e2e-api-b-cd7f5c-57976b7948 from 0 to 1 40m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-cd7f5c-57976b7948 Created pod: payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd 40m Normal Pulled pod/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Warning Unhealthy pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Startup probe failed: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused 40m Normal AddedLabel gateway/e2e-shared-b-w0-a476f8 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-a476f8 40m Normal AddedInterface pod/payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd Add eth0 [10.133.0.110/23] from ovn-kubernetes 40m Warning ProbeError pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Startup probe error: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused... 40m Normal Started pod/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr Container started 40m Normal Created pod/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr Container created 40m Normal Pulled pod/payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal Created pod/payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd Container created 40m Normal Started pod/payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd Container started 40m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr Add eth0 [10.133.0.111/23] from ovn-kubernetes 40m Normal ScalingReplicaSet deployment/e2e-shared-b-w0-a476f8-openshift-default Scaled up replica set e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc from 0 to 1 40m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc Created pod: e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx 40m Normal AddedInterface pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Add eth0 [10.132.0.179/23] from ovn-kubernetes 40m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f Created pod: payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp 40m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w0-a476f8 Scaled up replica set payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f from 0 to 1 40m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w0-a476f8-77865dd486 Error creating: pods "payload-processing-e2e-shared-b-w0-a476f8-77865dd486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-a476f8: serviceaccount "payload-processing-e2e-shared-b-w0-a476f8" not found 40m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w0-a476f8-77865dd486 Created pod: payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd 40m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w0-a476f8 Scaled up replica set payload-processing-e2e-shared-b-w0-a476f8-77865dd486 from 0 to 1 40m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f Error creating: pods "payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-a476f8: serviceaccount "payload-processing-e2e-shared-b-w0-a476f8" not found 40m Normal AddedLabel gateway/e2e-mt-5b918c5d Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5b918c5d 40m Normal ScalingReplicaSet deployment/e2e-mt-5b918c5d-openshift-default Scaled up replica set e2e-mt-5b918c5d-openshift-default-697bf5d6df from 0 to 1 40m Normal SuccessfulCreate replicaset/e2e-mt-5b918c5d-openshift-default-697bf5d6df Created pod: e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q 40m Normal Pulled pod/payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd Add eth0 [10.133.0.112/23] from ovn-kubernetes 40m Normal Started pod/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp Container started 40m Normal Started pod/payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd Container started 40m Normal Created pod/payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd Container created 40m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp Add eth0 [10.132.0.181/23] from ovn-kubernetes 40m Normal Created pod/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp Container created 40m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q Add eth0 [10.133.0.113/23] from ovn-kubernetes 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-d441dd-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-d441dd-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Normal Killing pod/payload-processing-e2e-api-a-d441dd-6cdf67d9b-st7cp Stopping container payload-processing 40m Normal Killing pod/payload-pre-processing-e2e-api-a-d441dd-64db594499-vhhfz Stopping container payload-pre-processing 40m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-5b918c5d-5fb474f47d Created pod: payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 40m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9 Error creating: pods "payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5b918c5d: serviceaccount "payload-processing-e2e-mt-5b918c5d" not found 40m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-5b918c5d Scaled up replica set payload-processing-e2e-mt-5b918c5d-5fb474f47d from 0 to 1 40m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9 Created pod: payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx 40m Warning FailedCreate replicaset/payload-processing-e2e-mt-5b918c5d-5fb474f47d Error creating: pods "payload-processing-e2e-mt-5b918c5d-5fb474f47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5b918c5d: serviceaccount "payload-processing-e2e-mt-5b918c5d" not found 40m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-5b918c5d Scaled up replica set payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9 from 0 to 1 40m Normal Pulled pod/payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 Add eth0 [10.133.0.115/23] from ovn-kubernetes 40m Normal Started pod/payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 Container started 40m Normal Started pod/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx Container started 40m Normal Created pod/payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 Container created 40m Normal Created pod/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx Container created 40m Normal AddedInterface pod/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx Add eth0 [10.133.0.114/23] from ovn-kubernetes 40m Normal Pulled pod/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w0-a476f8-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w0-a476f8-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Warning ProbeError pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Readiness probe error: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning Unhealthy pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Readiness probe failed: Get "http://10.132.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-cd7f5c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 39m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-cd7f5c-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 39m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d 39m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled up replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 1 to 4 39m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s 39m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Add eth0 [10.133.0.117/23] from ovn-kubernetes 39m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn 39m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Add eth0 [10.133.0.116/23] from ovn-kubernetes 39m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Container started 39m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Add eth0 [10.132.0.184/23] from ovn-kubernetes 39m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Container created 39m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Container started 39m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Container created 39m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Container created 39m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Container started 39m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Readiness probe error: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Readiness probe failed: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Normal Created pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Container created 39m Normal Pulled pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-1962f9-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 39m Normal Killing pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-vcszx Stopping container payload-pre-processing 39m Normal Started pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Container started 39m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused 39m Normal Killing pod/payload-processing-e2e-mt-acd98d21-784b68d996-gvnhk Stopping container payload-processing 39m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused... 39m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-1962f9-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 39m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused 39m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused 39m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Container created 39m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Container started 39m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Warning Unhealthy pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused 39m Warning ProbeError pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused... 39m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused 39m Normal Killing pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Stopping container istio-proxy 39m Normal ScalingReplicaSet deployment/e2e-api-a-433102-openshift-default Scaled up replica set e2e-api-a-433102-openshift-default-555967f4f5 from 0 to 1 39m Normal SuccessfulCreate replicaset/e2e-api-a-433102-openshift-default-555967f4f5 Created pod: e2e-api-a-433102-openshift-default-555967f4f5-hjlkq 39m Normal AddedLabel gateway/e2e-api-a-433102 Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-433102 39m Normal AddedInterface pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Add eth0 [10.132.0.188/23] from ovn-kubernetes 39m Warning Unhealthy pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Readiness probe failed: HTTP probe failed with statuscode: 503 39m Warning ProbeError pod/e2e-api-a-d441dd-openshift-default-64bfb6d74c-6j4d8 Readiness probe error: HTTP probe failed with statuscode: 503... 39m Normal Killing pod/payload-pre-processing-e2e-api-a-1962f9-55df7dc9c9-4pcn2 Stopping container payload-pre-processing 39m Normal Killing pod/payload-processing-e2e-api-a-1962f9-77fcbfdbf6-vkqw7 Stopping container payload-processing 39m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-5b918c5d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-5b918c5d-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-433102 Scaled up replica set payload-processing-e2e-api-a-433102-b5fc7466d from 0 to 1 39m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9 Error creating: pods "payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-433102: serviceaccount "payload-processing-e2e-api-a-433102" not found 39m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-433102 Scaled up replica set payload-pre-processing-e2e-api-a-433102-7ccd48d8f9 from 0 to 1 39m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-433102-b5fc7466d Created pod: payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd 39m Warning FailedCreate replicaset/payload-processing-e2e-api-a-433102-b5fc7466d Error creating: pods "payload-processing-e2e-api-a-433102-b5fc7466d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-433102: serviceaccount "payload-processing-e2e-api-a-433102" not found 39m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9 Created pod: payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc 39m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc Add eth0 [10.132.0.190/23] from ovn-kubernetes 39m Normal Pulled pod/payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 39m Normal Created pod/payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd Container created 39m Normal Created pod/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc Container created 39m Normal AddedInterface pod/payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd Add eth0 [10.132.0.189/23] from ovn-kubernetes 39m Normal Started pod/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc Container started 39m Normal Pulled pod/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 39m Normal Started pod/payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd Container started 39m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 39m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 39m Normal ScalingReplicaSet deployment/e2e-inf-a-49fb2b-openshift-default Scaled up replica set e2e-inf-a-49fb2b-openshift-default-569f598477 from 0 to 1 39m Normal AddedLabel gateway/e2e-inf-a-49fb2b Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-49fb2b 39m Normal SuccessfulCreate replicaset/e2e-inf-a-49fb2b-openshift-default-569f598477 Created pod: e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv 39m Normal Killing pod/payload-pre-processing-e2e-api-b-b9dc48-56b9bcd659-k5d4w Stopping container payload-pre-processing 39m Normal Killing pod/payload-processing-e2e-api-b-b9dc48-9d6cf9dd8-545xd Stopping container payload-processing 39m Normal AddedInterface pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Add eth0 [10.133.0.119/23] from ovn-kubernetes 39m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-49fb2b Scaled up replica set payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc from 0 to 1 39m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-49fb2b Scaled up replica set payload-processing-e2e-inf-a-49fb2b-64ccbf5774 from 0 to 1 39m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-49fb2b-64ccbf5774 Error creating: pods "payload-processing-e2e-inf-a-49fb2b-64ccbf5774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-49fb2b: serviceaccount "payload-processing-e2e-inf-a-49fb2b" not found 39m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-49fb2b-64ccbf5774 Created pod: payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t 39m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc Created pod: payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws 39m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc Error creating: pods "payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-49fb2b: serviceaccount "payload-processing-e2e-inf-a-49fb2b" not found 39m Normal Created pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Container created 39m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Add eth0 [10.132.0.191/23] from ovn-kubernetes 39m Normal AddedInterface pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Add eth0 [10.132.0.192/23] from ovn-kubernetes 39m Normal Started pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Container started 39m Normal Pulled pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 39m Normal Pulled pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 39m Normal Started pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Container started 39m Normal Created pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Container created 39m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-acd98d21 Scaled up replica set payload-processing-e2e-mt-acd98d21-784b68d996 from 0 to 1 39m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-acd98d21 Scaled up replica set payload-pre-processing-e2e-mt-acd98d21-555b65457f from 0 to 1 39m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-acd98d21-555b65457f Error creating: pods "payload-pre-processing-e2e-mt-acd98d21-555b65457f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-acd98d21: serviceaccount "payload-processing-e2e-mt-acd98d21" not found 39m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-acd98d21-555b65457f Created pod: payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 39m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-acd98d21-784b68d996 Created pod: payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc 39m Warning FailedCreate replicaset/payload-processing-e2e-mt-acd98d21-784b68d996 Error creating: pods "payload-processing-e2e-mt-acd98d21-784b68d996-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-acd98d21: serviceaccount "payload-processing-e2e-mt-acd98d21" not found 39m Normal Started pod/payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc Container started 39m Normal Created pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 Container created 39m Normal AddedInterface pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 Add eth0 [10.132.0.193/23] from ovn-kubernetes 39m Normal AddedInterface pod/payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc Add eth0 [10.133.0.120/23] from ovn-kubernetes 39m Normal Pulled pod/payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 39m Normal Created pod/payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc Container created 39m Normal Started pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 Container started 39m Normal Pulled pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 39m Normal SuccessfulCreate replicaset/e2e-api-b-b9dc48-openshift-default-75564dbdc5 Created pod: e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz 39m Normal ScalingReplicaSet deployment/e2e-api-b-b9dc48-openshift-default Scaled up replica set e2e-api-b-b9dc48-openshift-default-75564dbdc5 from 1 to 4 39m Normal SuccessfulRescale horizontalpodautoscaler/e2e-api-b-b9dc48-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 39m Normal SuccessfulCreate replicaset/e2e-api-b-b9dc48-openshift-default-75564dbdc5 Created pod: e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq 39m Normal SuccessfulCreate replicaset/e2e-api-b-b9dc48-openshift-default-75564dbdc5 Created pod: e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 39m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll 39m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default New size: 7; reason: 39m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled up replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 4 to 7 39m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz 39m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j 39m Normal Pulled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Add eth0 [10.133.0.122/23] from ovn-kubernetes 39m Normal AddedInterface pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Add eth0 [10.133.0.121/23] from ovn-kubernetes 39m Normal Pulled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Add eth0 [10.132.0.194/23] from ovn-kubernetes 39m Normal Started pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Container started 39m Normal Started pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Container started 39m Normal AddedInterface pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Add eth0 [10.132.0.195/23] from ovn-kubernetes 39m Normal Created pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Container created 39m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Created pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Container created 39m Normal Pulled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Started pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Container started 39m Normal Created pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Container created 39m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Container created 39m Warning ProbeError pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Readiness probe error: Get "http://10.133.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 39m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Container started 39m Warning Unhealthy pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Readiness probe failed: Get "http://10.133.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled down replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 10 to 8 39m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 Stopping container istio-proxy 39m Normal SuccessfulDelete replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Deleted pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-x8gx9 39m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 8; reason: All metrics below target 39m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m Stopping container istio-proxy 39m Normal SuccessfulDelete replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Deleted pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-z9t6m 39m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled down replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 10 to 8 39m Normal SuccessfulDelete replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Deleted pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks 39m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 8; reason: All metrics below target 39m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Stopping container istio-proxy 39m Normal SuccessfulDelete replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Deleted pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz 39m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-tt6ks Stopping container istio-proxy 39m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-1962f9-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-1962f9-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Container created 39m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Container started 39m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Add eth0 [10.134.0.102/23] from ovn-kubernetes 38m Warning ProbeError pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Startup probe error: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused... 38m Warning Unhealthy pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Startup probe failed: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused 38m Warning Unhealthy pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused 38m Warning ProbeError pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused... 38m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Container started 38m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused 38m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Add eth0 [10.134.0.103/23] from ovn-kubernetes 38m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Container created 38m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused... 38m Warning Unhealthy pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused 38m Normal Pulled pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Created pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Container created 38m Normal Started pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Container started 38m Warning ProbeError pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused... 38m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-p8hjz Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-b9dc48-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-b9dc48-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Normal Killing pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Stopping container istio-proxy 38m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused 38m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused... 38m Warning ProbeError pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Readiness probe error: HTTP probe failed with statuscode: 503... 38m Warning Unhealthy pod/e2e-api-a-1962f9-openshift-default-56464595f-d2j7d Readiness probe failed: HTTP probe failed with statuscode: 503 38m Warning ProbeError pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Readiness probe error: Get "http://10.133.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 38m Warning Unhealthy pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Readiness probe failed: Get "http://10.133.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused 38m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused... 38m Warning ProbeError pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused... 38m Normal Pulled pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Warning Unhealthy pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused 38m Normal Started pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Container started 38m Normal Created pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Container created 38m Normal ScalingReplicaSet deployment/e2e-api-b-caa01a-openshift-default Scaled up replica set e2e-api-b-caa01a-openshift-default-7c546c7465 from 0 to 1 38m Normal SuccessfulCreate replicaset/e2e-api-b-caa01a-openshift-default-7c546c7465 Created pod: e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x 38m Normal AddedLabel gateway/e2e-api-b-caa01a Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-caa01a 38m Normal AddedInterface pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Add eth0 [10.132.0.196/23] from ovn-kubernetes 38m Normal Killing pod/payload-processing-e2e-api-b-cd7f5c-57976b7948-scqtd Stopping container payload-processing 38m Normal Killing pod/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr Stopping container payload-pre-processing 38m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-caa01a Scaled up replica set payload-processing-e2e-api-b-caa01a-5f66f584db from 0 to 1 38m Warning FailedCreate replicaset/payload-processing-e2e-api-b-caa01a-5f66f584db Error creating: pods "payload-processing-e2e-api-b-caa01a-5f66f584db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-caa01a: serviceaccount "payload-processing-e2e-api-b-caa01a" not found 38m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc Created pod: payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg 38m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc Error creating: pods "payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-caa01a: serviceaccount "payload-processing-e2e-api-b-caa01a" not found 38m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-caa01a Scaled up replica set payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc from 0 to 1 38m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-caa01a-5f66f584db Created pod: payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x 38m Normal AddedInterface pod/payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x Add eth0 [10.133.0.125/23] from ovn-kubernetes 38m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg Add eth0 [10.133.0.126/23] from ovn-kubernetes 38m Normal Pulled pod/payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Pulled pod/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Warning ProbeError pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused... 38m Normal Started pod/payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x Container started 38m Warning Unhealthy pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused 38m Normal Created pod/payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x Container created 38m Normal Created pod/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg Container created 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-b9dc48-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-b9dc48-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Normal Started pod/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg Container started 38m Normal AddedLabel gateway/e2e-inf-b-facc79 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-facc79 38m Normal Killing pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-r2tqz Stopping container istio-proxy 38m Normal ScalingReplicaSet deployment/e2e-inf-b-facc79-openshift-default Scaled up replica set e2e-inf-b-facc79-openshift-default-5bdf4749c9 from 0 to 1 38m Normal SuccessfulCreate replicaset/e2e-inf-b-facc79-openshift-default-5bdf4749c9 Created pod: e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh 38m Normal Killing pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-h2gx2 Stopping container istio-proxy 38m Warning Unhealthy pod/payload-pre-processing-e2e-api-b-cd7f5c-844f7f5d55-jxjkr Readiness probe failed: timeout: failed to connect service "10.133.0.111:50052" within 1s: context deadline exceeded 38m Normal Killing pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-5kldq Stopping container istio-proxy 38m Normal Killing pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Stopping container istio-proxy 38m Normal AddedLabel gateway/e2e-inf-a-43b780 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-43b780 38m Normal SuccessfulCreate replicaset/e2e-inf-a-43b780-openshift-default-5976c46f47 Created pod: e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 38m Normal Pulled pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 Add eth0 [10.134.0.106/23] from ovn-kubernetes 38m Normal ScalingReplicaSet deployment/e2e-inf-a-43b780-openshift-default Scaled up replica set e2e-inf-a-43b780-openshift-default-5976c46f47 from 0 to 1 38m Normal AddedInterface pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Add eth0 [10.133.0.127/23] from ovn-kubernetes 38m Normal Created pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 Container created 38m Normal Started pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 Container started 38m Warning Unhealthy pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Readiness probe failed: HTTP probe failed with statuscode: 503 38m Warning ProbeError pod/e2e-api-b-b9dc48-openshift-default-75564dbdc5-6wsdc Readiness probe error: HTTP probe failed with statuscode: 503... 38m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c Created pod: payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms 38m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-43b780 Scaled up replica set payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c from 0 to 1 38m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c Error creating: pods "payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-43b780: serviceaccount "payload-processing-e2e-inf-a-43b780" not found 38m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-43b780-b75f87544 Error creating: pods "payload-processing-e2e-inf-a-43b780-b75f87544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-43b780: serviceaccount "payload-processing-e2e-inf-a-43b780" not found 38m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-43b780 Scaled up replica set payload-processing-e2e-inf-a-43b780-b75f87544 from 0 to 1 38m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-43b780-b75f87544 Created pod: payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 38m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-facc79 Scaled up replica set payload-processing-e2e-inf-b-facc79-6b465554d4 from 0 to 1 38m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-facc79-6b465554d4 Created pod: payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw 38m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms Add eth0 [10.132.0.197/23] from ovn-kubernetes 38m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-facc79-6b465554d4 Error creating: pods "payload-processing-e2e-inf-b-facc79-6b465554d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-facc79: serviceaccount "payload-processing-e2e-inf-b-facc79" not found 38m Normal Created pod/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms Container created 38m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-facc79 Scaled up replica set payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc from 0 to 1 38m Normal Started pod/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms Container started 38m Normal Pulled pod/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 Add eth0 [10.132.0.198/23] from ovn-kubernetes 38m Normal Pulled pod/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc Error creating: pods "payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-facc79: serviceaccount "payload-processing-e2e-inf-b-facc79" not found 38m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc Created pod: payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx 38m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx Add eth0 [10.133.0.129/23] from ovn-kubernetes 38m Normal Pulled pod/payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Pulled pod/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 38m Normal Created pod/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 Container created 38m Normal Started pod/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 Container started 38m Normal AddedInterface pod/payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw Add eth0 [10.132.0.199/23] from ovn-kubernetes 38m Normal Created pod/payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw Container created 38m Normal Started pod/payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw Container started 38m Normal Created pod/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx Container created 38m Normal Started pod/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx Container started 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-cd7f5c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-cd7f5c-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Normal Killing pod/payload-pre-processing-e2e-mt-acd98d21-555b65457f-xxt66 Stopping container payload-pre-processing 38m Normal Killing pod/payload-processing-e2e-mt-acd98d21-784b68d996-kjpjc Stopping container payload-processing 38m Normal SuccessfulDelete replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Deleted pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 38m Normal SuccessfulDelete replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Deleted pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx 38m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-frfbx Stopping container istio-proxy 38m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 8; reason: All metrics below target 38m Normal SuccessfulDelete replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Deleted pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd 38m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-76wcd Stopping container istio-proxy 38m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-fqkj8 Stopping container istio-proxy 38m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl Stopping container istio-proxy 38m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled down replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 10 to 8 38m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 8; reason: All metrics below target 38m Normal SuccessfulDelete replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Deleted pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-84mkl 38m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled down replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 10 to 8 38m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 5; reason: cpu resource utilization (percentage of request) above target 38m Normal SuccessfulCreate replicaset/e2e-inf-a-43b780-openshift-default-5976c46f47 Created pod: e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw 38m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-vqvll Stopping container istio-proxy 38m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-9cmmw 38m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w 38m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 5 38m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw 38m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-jczrz Stopping container istio-proxy 38m Normal Killing pod/e2e-inf-a-43b780-openshift-default-5976c46f47-7bjv7 Stopping container istio-proxy 38m Normal Created pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Container created 38m Normal Pulled pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Add eth0 [10.133.0.134/23] from ovn-kubernetes 38m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Container created 38m Normal Started pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Container started 38m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Container started 38m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Add eth0 [10.134.0.107/23] from ovn-kubernetes 38m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Container started 38m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Container started 38m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Container created 38m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 38m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Add eth0 [10.134.0.108/23] from ovn-kubernetes 38m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Container created 38m Normal AddedInterface pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Add eth0 [10.134.0.109/23] from ovn-kubernetes 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-49fb2b-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-49fb2b-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Readiness probe failed: HTTP probe failed with statuscode: 503 38m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Readiness probe error: HTTP probe failed with statuscode: 503... 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-facc79-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-facc79-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused 38m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused... 38m Warning Unhealthy pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused 38m Warning ProbeError pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused... 38m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused 38m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused... 38m Normal Killing pod/e2e-api-b-cd7f5c-openshift-default-f7d549ddc-lfp5j Stopping container istio-proxy 37m Normal AddedLabel gateway/e2e-inf-a-663013 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-663013 37m Normal ScalingReplicaSet deployment/e2e-inf-a-663013-openshift-default Scaled up replica set e2e-inf-a-663013-openshift-default-8678b5b749 from 0 to 1 37m Normal SuccessfulCreate replicaset/e2e-inf-a-663013-openshift-default-8678b5b749 Created pod: e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz 37m Normal AddedInterface pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Add eth0 [10.134.0.111/23] from ovn-kubernetes 37m Normal SuccessfulCreate replicaset/e2e-mt-acd98d21-openshift-default-7ffbccb87c Created pod: e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 37m Normal SuccessfulRescale horizontalpodautoscaler/e2e-mt-acd98d21-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 37m Normal ScalingReplicaSet deployment/e2e-mt-acd98d21-openshift-default Scaled up replica set e2e-mt-acd98d21-openshift-default-7ffbccb87c from 2 to 3 37m Normal ScalingReplicaSet deployment/e2e-inf-b-f817b0-openshift-default Scaled up replica set e2e-inf-b-f817b0-openshift-default-64d96d4677 from 0 to 1 37m Normal AddedLabel gateway/e2e-inf-b-f817b0 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f817b0 37m Normal SuccessfulCreate replicaset/e2e-inf-b-f817b0-openshift-default-64d96d4677 Created pod: e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q 37m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-663013 Scaled up replica set payload-pre-processing-e2e-inf-a-663013-56888c558c from 0 to 1 37m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-663013-56888c558c Error creating: pods "payload-pre-processing-e2e-inf-a-663013-56888c558c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-663013: serviceaccount "payload-processing-e2e-inf-a-663013" not found 37m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-663013-56888c558c Created pod: payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 37m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-663013 Scaled up replica set payload-processing-e2e-inf-a-663013-848b6d9486 from 0 to 1 37m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-663013-848b6d9486 Created pod: payload-processing-e2e-inf-a-663013-848b6d9486-s696n 37m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-663013-848b6d9486 Error creating: pods "payload-processing-e2e-inf-a-663013-848b6d9486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-663013: serviceaccount "payload-processing-e2e-inf-a-663013" not found 37m Normal AddedInterface pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Add eth0 [10.133.0.136/23] from ovn-kubernetes 37m Normal Pulled pod/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal Started pod/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 Container started 37m Normal Created pod/payload-processing-e2e-inf-a-663013-848b6d9486-s696n Container created 37m Normal Created pod/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 Container created 37m Normal Started pod/payload-processing-e2e-inf-a-663013-848b6d9486-s696n Container started 37m Normal Pulled pod/payload-processing-e2e-inf-a-663013-848b6d9486-s696n Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal AddedInterface pod/payload-processing-e2e-inf-a-663013-848b6d9486-s696n Add eth0 [10.134.0.113/23] from ovn-kubernetes 37m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 Add eth0 [10.133.0.137/23] from ovn-kubernetes 37m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-f817b0-8784455dc Error creating: pods "payload-pre-processing-e2e-inf-b-f817b0-8784455dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f817b0: serviceaccount "payload-processing-e2e-inf-b-f817b0" not found 37m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-f817b0 Scaled up replica set payload-processing-e2e-inf-b-f817b0-759b8969db from 0 to 1 37m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-f817b0-759b8969db Created pod: payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v 37m Normal Killing pod/payload-pre-processing-e2e-api-a-433102-7ccd48d8f9-5xjsc Stopping container payload-pre-processing 37m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-f817b0-8784455dc Created pod: payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk 37m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-f817b0 Scaled up replica set payload-pre-processing-e2e-inf-b-f817b0-8784455dc from 0 to 1 37m Normal SuccessfulDelete replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Deleted pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm 37m Normal Killing pod/payload-processing-e2e-api-a-433102-b5fc7466d-j6pdd Stopping container payload-processing 37m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 9; reason: All metrics below target 37m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default Scaled down replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 10 to 9 37m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-f817b0-759b8969db Error creating: pods "payload-processing-e2e-inf-b-f817b0-759b8969db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f817b0: serviceaccount "payload-processing-e2e-inf-b-f817b0" not found 37m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled down replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 10 to 9 37m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-5j6zm Stopping container istio-proxy 37m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 9; reason: All metrics below target 37m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 Stopping container istio-proxy 37m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled down replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 10 to 9 37m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk Add eth0 [10.133.0.138/23] from ovn-kubernetes 37m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Stopping container istio-proxy 37m Normal Pulled pod/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 9; reason: All metrics below target 37m Normal SuccessfulDelete replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Deleted pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-dbgl7 37m Normal SuccessfulDelete replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Deleted pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc 37m Normal Created pod/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk Container created 37m Normal Started pod/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk Container started 37m Warning ProbeError pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-44qkc Readiness probe error: HTTP probe failed with statuscode: 503... 37m Normal Killing pod/payload-processing-e2e-mt-5b918c5d-5fb474f47d-mvtv8 Stopping container payload-processing 37m Normal Killing pod/payload-pre-processing-e2e-mt-5b918c5d-65c99f94c9-f5fqx Stopping container payload-pre-processing 37m Normal Started pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Container started 37m Normal Created pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Container created 37m Normal Pulled pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 37m Normal AddedInterface pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Add eth0 [10.134.0.114/23] from ovn-kubernetes 37m Normal Started pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Container started 37m Normal Started pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v Container started 37m Normal Created pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Container created 37m Normal Pulled pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 37m Normal Created pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v Container created 37m Normal Pulled pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal AddedInterface pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v Add eth0 [10.132.0.201/23] from ovn-kubernetes 37m Warning Unhealthy pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Startup probe failed: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused 37m Warning ProbeError pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Startup probe error: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused... 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-49fb2b-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-49fb2b-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Warning ProbeError pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Startup probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused... 37m Warning Unhealthy pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Startup probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused 37m Normal Created pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Container created 37m Normal Started pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Container started 37m Normal Pulled pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 37m Normal Pulled pod/e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-caa01a-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Normal Created pod/e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q Container created 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-433102-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-433102-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 37m Normal Started pod/e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q Container started 37m Normal Killing pod/e2e-mt-5b918c5d-openshift-default-697bf5d6df-lgs6q Stopping container istio-proxy 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-caa01a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Normal ScalingReplicaSet deployment/e2e-inf-a-2092ba-openshift-default Scaled up replica set e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc from 0 to 1 37m Normal AddedLabel gateway/e2e-inf-a-2092ba Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2092ba 37m Normal SuccessfulCreate replicaset/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc Created pod: e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md 37m Normal AddedInterface pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Add eth0 [10.133.0.141/23] from ovn-kubernetes 37m Warning ProbeError pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused... 37m Warning Unhealthy pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused 37m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-2092ba Scaled up replica set payload-processing-e2e-inf-a-2092ba-645468456d from 0 to 1 37m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-2092ba-5495d58799 Created pod: payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 37m Normal Killing pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr Stopping container istio-proxy 37m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-2092ba-645468456d Error creating: pods "payload-processing-e2e-inf-a-2092ba-645468456d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2092ba: serviceaccount "payload-processing-e2e-inf-a-2092ba" not found 37m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-d81d18-openshift-default New size: 3; reason: All metrics below target 37m Normal SuccessfulDelete replicaset/e2e-shared-a-w1-d81d18-openshift-default-66479b569c Deleted pod: e2e-shared-a-w1-d81d18-openshift-default-66479b569c-hkbkr 37m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-d81d18-openshift-default Scaled down replica set e2e-shared-a-w1-d81d18-openshift-default-66479b569c from 4 to 3 37m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-2092ba Scaled up replica set payload-pre-processing-e2e-inf-a-2092ba-5495d58799 from 0 to 1 37m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-2092ba-5495d58799 Error creating: pods "payload-pre-processing-e2e-inf-a-2092ba-5495d58799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2092ba: serviceaccount "payload-processing-e2e-inf-a-2092ba" not found 37m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-2092ba-645468456d Created pod: payload-processing-e2e-inf-a-2092ba-645468456d-bstpt 37m Normal Created pod/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 Container created 37m Normal Created pod/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt Container created 37m Normal Pulled pod/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 Add eth0 [10.133.0.142/23] from ovn-kubernetes 37m Normal Pulled pod/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Normal Started pod/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt Container started 37m Normal AddedInterface pod/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt Add eth0 [10.133.0.143/23] from ovn-kubernetes 37m Normal Started pod/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 Container started 37m Normal Killing pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-vlxq6 Stopping container istio-proxy 37m Warning Unhealthy pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Readiness probe failed: HTTP probe failed with statuscode: 503 37m Normal Killing pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-99k25 Stopping container istio-proxy 37m Normal Killing pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Stopping container istio-proxy 37m Warning ProbeError pod/e2e-mt-acd98d21-openshift-default-7ffbccb87c-ldcww Readiness probe error: HTTP probe failed with statuscode: 503... 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-caa01a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-433102-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-caa01a-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 37m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-433102-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 37m Normal SuccessfulCreate replicaset/e2e-inf-b-babea4-openshift-default-5d69cb64f9 Created pod: e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz 37m Normal AddedLabel gateway/e2e-inf-b-babea4 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-babea4 37m Normal ScalingReplicaSet deployment/e2e-inf-b-babea4-openshift-default Scaled up replica set e2e-inf-b-babea4-openshift-default-5d69cb64f9 from 0 to 1 37m Normal Killing pod/e2e-api-a-433102-openshift-default-555967f4f5-hjlkq Stopping container istio-proxy 37m Normal AddedInterface pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Add eth0 [10.133.0.144/23] from ovn-kubernetes 37m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-babea4 Scaled up replica set payload-pre-processing-e2e-inf-b-babea4-6464c57675 from 0 to 1 37m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 7; reason: All metrics below target 37m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled down replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 8 to 7 37m Normal SuccessfulDelete replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Deleted pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 37m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-babea4-69dd894f84 Error creating: pods "payload-processing-e2e-inf-b-babea4-69dd894f84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-babea4: serviceaccount "payload-processing-e2e-inf-b-babea4" not found 37m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-babea4 Scaled up replica set payload-processing-e2e-inf-b-babea4-69dd894f84 from 0 to 1 37m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz Add eth0 [10.132.0.204/23] from ovn-kubernetes 37m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-babea4-6464c57675 Created pod: payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz 37m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-babea4-69dd894f84 Created pod: payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq 37m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-5mgv9 Stopping container istio-proxy 37m Normal Pulled pod/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-babea4-6464c57675 Error creating: pods "payload-pre-processing-e2e-inf-b-babea4-6464c57675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-babea4: serviceaccount "payload-processing-e2e-inf-b-babea4" not found 37m Normal Started pod/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz Container started 37m Warning Unhealthy pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Readiness probe failed: Get "http://10.133.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 37m Normal Started pod/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq Container started 37m Normal Created pod/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq Container created 37m Normal Pulled pod/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 37m Warning ProbeError pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Readiness probe error: Get "http://10.133.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 37m Normal Created pod/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz Container created 37m Normal AddedInterface pod/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq Add eth0 [10.132.0.205/23] from ovn-kubernetes 37m Normal Killing pod/payload-pre-processing-e2e-api-b-caa01a-7f7dccf9bc-69rpg Stopping container payload-pre-processing 37m Normal Killing pod/payload-processing-e2e-api-b-caa01a-5f66f584db-gx57x Stopping container payload-processing 36m Normal Created pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Container created 36m Normal Started pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Container started 36m Normal Pulled pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Created pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Container created 36m Warning Unhealthy pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Readiness probe failed: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 36m Normal Pulled pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Warning ProbeError pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Readiness probe error: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 36m Normal Started pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Container started 36m Normal Pulled pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Started pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Container started 36m Normal Created pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Container created 36m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-49fb2b-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 36m Normal Created pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Container created 36m Warning ProbeError pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused... 36m Normal SuccessfulCreate replicaset/e2e-inf-a-49fb2b-openshift-default-569f598477 Created pod: e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 36m Normal ScalingReplicaSet deployment/e2e-inf-a-49fb2b-openshift-default Scaled up replica set e2e-inf-a-49fb2b-openshift-default-569f598477 from 1 to 2 36m Warning Unhealthy pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused 36m Normal AddedInterface pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Add eth0 [10.132.0.206/23] from ovn-kubernetes 36m Normal Pulled pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Started pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Container started 36m Warning Unhealthy pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-43b780-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 36m Warning ProbeError pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused... 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-43b780-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 36m Warning ProbeError pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused... 36m Warning Unhealthy pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused 36m Normal AddedLabel gateway/e2e-inf-b-9b1aed Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9b1aed 36m Normal ScalingReplicaSet deployment/e2e-inf-b-9b1aed-openshift-default Scaled up replica set e2e-inf-b-9b1aed-openshift-default-69b65857d9 from 0 to 1 36m Normal SuccessfulCreate replicaset/e2e-inf-b-9b1aed-openshift-default-69b65857d9 Created pod: e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-663013-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 36m Warning ProbeError pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Startup probe error: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused... 36m Warning Unhealthy pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Startup probe failed: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused 36m Normal AddedInterface pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Add eth0 [10.132.0.207/23] from ovn-kubernetes 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-663013-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 36m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87 Created pod: payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd 36m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-9b1aed Scaled up replica set payload-processing-e2e-inf-b-9b1aed-56586c9b6 from 0 to 1 36m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-9b1aed Scaled up replica set payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87 from 0 to 1 36m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87 Error creating: pods "payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b1aed: serviceaccount "payload-processing-e2e-inf-b-9b1aed" not found 36m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-9b1aed-56586c9b6 Error creating: pods "payload-processing-e2e-inf-b-9b1aed-56586c9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b1aed: serviceaccount "payload-processing-e2e-inf-b-9b1aed" not found 36m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-9b1aed-56586c9b6 Created pod: payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 36m Normal Pulled pod/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd Add eth0 [10.133.0.146/23] from ovn-kubernetes 36m Normal Started pod/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd Container started 36m Normal AddedInterface pod/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 Add eth0 [10.133.0.147/23] from ovn-kubernetes 36m Normal Created pod/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 Container created 36m Normal Pulled pod/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal Created pod/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd Container created 36m Normal Started pod/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 Container started 36m Normal ScalingReplicaSet deployment/e2e-inf-a-22a567-openshift-default Scaled up replica set e2e-inf-a-22a567-openshift-default-ff7c86f85 from 0 to 1 36m Normal AddedLabel gateway/e2e-inf-a-22a567 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-22a567 36m Normal SuccessfulCreate replicaset/e2e-inf-a-22a567-openshift-default-ff7c86f85 Created pod: e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw 36m Normal AddedInterface pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Add eth0 [10.133.0.148/23] from ovn-kubernetes 36m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-22a567 Scaled up replica set payload-processing-e2e-inf-a-22a567-766dc74f8 from 0 to 1 36m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-22a567 Scaled up replica set payload-pre-processing-e2e-inf-a-22a567-66dcddf555 from 0 to 1 36m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-22a567-766dc74f8 Created pod: payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck 36m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-22a567-66dcddf555 Error creating: pods "payload-pre-processing-e2e-inf-a-22a567-66dcddf555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-22a567: serviceaccount "payload-processing-e2e-inf-a-22a567" not found 36m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-22a567-66dcddf555 Created pod: payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 36m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-22a567-766dc74f8 Error creating: pods "payload-processing-e2e-inf-a-22a567-766dc74f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-22a567: serviceaccount "payload-processing-e2e-inf-a-22a567" not found 36m Normal Pulled pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal Created pod/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 Container created 36m Normal AddedInterface pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Add eth0 [10.133.0.149/23] from ovn-kubernetes 36m Normal Pulled pod/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal Created pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Container created 36m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 Add eth0 [10.132.0.208/23] from ovn-kubernetes 36m Normal Started pod/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 Container started 36m Normal Started pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Container started 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-facc79-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-facc79-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Normal Killing pod/e2e-api-b-caa01a-openshift-default-7c546c7465-ndl4x Stopping container istio-proxy 36m Normal ScalingReplicaSet deployment/e2e-inf-a-2c6c50-openshift-default Scaled up replica set e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 from 0 to 1 36m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc 36m Normal AddedLabel gateway/e2e-inf-a-2c6c50 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2c6c50 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-43b780-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-43b780-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-9b1aed-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-9b1aed-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 36m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-663013-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-663013-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 36m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Add eth0 [10.132.0.209/23] from ovn-kubernetes 36m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-2c6c50 Scaled up replica set payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6 from 0 to 1 36m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7 Error creating: pods "payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2c6c50: serviceaccount "payload-processing-e2e-inf-a-2c6c50" not found 36m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-2c6c50 Scaled up replica set payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7 from 0 to 1 36m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7 Created pod: payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf 36m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6 Error creating: pods "payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2c6c50: serviceaccount "payload-processing-e2e-inf-a-2c6c50" not found 36m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6 Created pod: payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n 36m Normal Created pod/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf Container created 36m Normal Started pod/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n Container started 36m Normal Created pod/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n Container created 36m Normal Pulled pod/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf Add eth0 [10.132.0.210/23] from ovn-kubernetes 36m Normal Pulled pod/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 36m Normal AddedInterface pod/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n Add eth0 [10.133.0.152/23] from ovn-kubernetes 36m Normal Started pod/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf Container started 36m Warning ProbeError pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Readiness probe error: Get "http://10.133.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 36m Warning Unhealthy pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Readiness probe failed: Get "http://10.133.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 36m Normal ScalingReplicaSet deployment/e2e-inf-a-43b780-openshift-default Scaled up replica set e2e-inf-a-43b780-openshift-default-5976c46f47 from 1 to 2 36m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-43b780-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 36m Normal SuccessfulCreate replicaset/e2e-inf-a-43b780-openshift-default-5976c46f47 Created pod: e2e-inf-a-43b780-openshift-default-5976c46f47-7pcns 36m Warning Unhealthy pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Readiness probe failed: Get "http://10.133.0.144:15021/healthz/ready": read tcp 10.133.0.2:40304->10.133.0.144:15021: read: connection reset by peer 36m Warning ProbeError pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Readiness probe error: Get "http://10.133.0.144:15021/healthz/ready": read tcp 10.133.0.2:40304->10.133.0.144:15021: read: connection reset by peer... 36m Normal Created pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Container created 36m Normal Pulled pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Started pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Container started 36m Normal Pulled pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 36m Normal Created pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Container created 36m Normal Started pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Container started 35m Warning Unhealthy pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused 35m Warning ProbeError pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused... 35m Warning Unhealthy pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-f817b0-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning ProbeError pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused... 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-f817b0-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-babea4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-babea4-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-f817b0-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-f817b0-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-2c6c50-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-2c6c50-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 7; reason: All metrics below target 35m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled down replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 8 to 7 35m Normal SuccessfulDelete replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Deleted pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz 35m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Stopping container istio-proxy 35m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Readiness probe error: HTTP probe failed with statuscode: 503... 35m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-d9gnz Readiness probe failed: HTTP probe failed with statuscode: 503 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-babea4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-babea4-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 35m Normal Created pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Container created 35m Normal Pulled pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Normal Started pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Container started 35m Warning Unhealthy pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused 35m Warning Unhealthy pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Readiness probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused 35m Warning ProbeError pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Readiness probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused... 35m Warning ProbeError pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused... 35m Normal Pulled pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Normal Started pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Container started 35m Normal Created pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Container created 35m Normal ScalingReplicaSet deployment/e2e-inf-b-27d3ad-openshift-default Scaled up replica set e2e-inf-b-27d3ad-openshift-default-85d7dd4c5 from 0 to 1 35m Normal AddedLabel gateway/e2e-inf-b-27d3ad Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-27d3ad 35m Normal SuccessfulCreate replicaset/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5 Created pod: e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl 35m Warning ProbeError pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused... 35m Warning Unhealthy pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused 35m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-22a567-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 35m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-22a567-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Normal ScalingReplicaSet deployment/e2e-inf-b-babea4-openshift-default Scaled up replica set e2e-inf-b-babea4-openshift-default-5d69cb64f9 from 1 to 2 34m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-babea4-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 34m Normal SuccessfulCreate replicaset/e2e-inf-b-babea4-openshift-default-5d69cb64f9 Created pod: e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 34m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Readiness probe error: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 34m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Readiness probe failed: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 34m Normal ScalingReplicaSet deployment/e2e-inf-a-46c34c-openshift-default Scaled up replica set e2e-inf-a-46c34c-openshift-default-5cc965c4d9 from 0 to 1 34m Normal AddedLabel gateway/e2e-inf-a-46c34c Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-46c34c 34m Normal SuccessfulCreate replicaset/e2e-inf-a-46c34c-openshift-default-5cc965c4d9 Created pod: e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 34m Normal Created pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Container created 34m Normal Pulled pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Started pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Container started 34m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 34m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j 34m Normal ScalingReplicaSet deployment/e2e-inf-a-2c6c50-openshift-default Scaled up replica set e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 from 1 to 4 34m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f 34m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-2c6c50-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-22a567-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-22a567-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-2092ba-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning Unhealthy pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused 34m Warning ProbeError pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused... 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-2092ba-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Readiness probe error: Get "http://10.132.0.209:15021/healthz/ready": read tcp 10.132.0.2:42584->10.132.0.209:15021: read: connection reset by peer... 34m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Readiness probe failed: Get "http://10.132.0.209:15021/healthz/ready": read tcp 10.132.0.2:42584->10.132.0.209:15021: read: connection reset by peer 34m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Container created 34m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Container started 34m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-9b1aed-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-9b1aed-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-2c6c50-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-2c6c50-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 34m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-2092ba-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-2092ba-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 34m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-2c6c50-openshift-default New size: 8; reason: All metrics below target 34m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 34m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk 34m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg 34m Normal SuccessfulCreate replicaset/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 Created pod: e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm 34m Normal ScalingReplicaSet deployment/e2e-inf-a-2c6c50-openshift-default Scaled up replica set e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77 from 4 to 8 33m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Readiness probe failed: Get "http://10.133.0.25:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 33m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Readiness probe error: Get "http://10.133.0.25:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 33m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 33m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 33m Normal SuccessfulDelete replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Deleted pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 33m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-g6547 Stopping container istio-proxy 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 7; reason: All metrics below target 33m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled down replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 8 to 7 33m Normal SuccessfulDelete replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Deleted pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 7; reason: All metrics below target 33m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled down replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 8 to 7 33m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-n447d Stopping container istio-proxy 33m Normal AddedInterface pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Add eth0 [10.133.0.153/23] from ovn-kubernetes 33m Normal Created pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Container created 33m Normal Started pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Container started 33m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Add eth0 [10.134.0.138/23] from ovn-kubernetes 33m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 33m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Container created 33m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Container started 33m Normal Pulled pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 33m Warning ProbeError pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Startup probe error: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused... 33m Warning Unhealthy pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Startup probe failed: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused 33m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Startup probe error: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused... 33m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Startup probe failed: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused 33m Normal SuccessfulDelete replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Deleted pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 33m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled down replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 9 to 8 33m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled down replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 9 to 7 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 7; reason: All metrics below target 33m Normal SuccessfulDelete replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Deleted pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default New size: 8; reason: All metrics below target 33m Normal SuccessfulDelete replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Deleted pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm 33m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-qqwhm Stopping container istio-proxy 33m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-tl2q8 Stopping container istio-proxy 33m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll Stopping container istio-proxy 33m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 8; reason: All metrics below target 33m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-8cr7b Stopping container istio-proxy 33m Normal SuccessfulDelete replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Deleted pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-6gxll 32m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Add eth0 [10.133.0.154/23] from ovn-kubernetes 32m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Add eth0 [10.134.0.139/23] from ovn-kubernetes 32m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Add eth0 [10.133.0.155/23] from ovn-kubernetes 32m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 32m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Container created 32m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Container started 32m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Container created 32m Normal AddedInterface pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Add eth0 [10.133.0.156/23] from ovn-kubernetes 32m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Container created 32m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Container started 32m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Container started 32m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d Created pod: payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j 32m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 Add eth0 [10.134.0.140/23] from ovn-kubernetes 32m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867 Error creating: pods "payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-46c34c: serviceaccount "payload-processing-e2e-inf-a-46c34c" not found 32m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867 Created pod: payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 32m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-46c34c Scaled up replica set payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867 from 0 to 1 32m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-46c34c Scaled up replica set payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d from 0 to 1 32m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d Error creating: pods "payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-46c34c: serviceaccount "payload-processing-e2e-inf-a-46c34c" not found 32m Normal Pulled pod/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused... 32m Normal Started pod/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 Container started 32m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused 32m Normal Created pod/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 Container created 32m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Startup probe error: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused... 32m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Startup probe failed: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused 32m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused 32m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused... 32m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d Stopping container istio-proxy 32m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled down replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 7 to 5 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default New size: 5; reason: All metrics below target 32m Normal SuccessfulDelete replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Deleted pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j 32m Normal SuccessfulDelete replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Deleted pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-nws6d 32m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-gfk8j Stopping container istio-proxy 32m Normal SuccessfulDelete replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Deleted pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk 32m Normal SuccessfulDelete replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Deleted pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd 32m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-b2rtd Stopping container istio-proxy 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 6; reason: All metrics below target 32m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default Scaled down replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 7 to 6 32m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv Stopping container istio-proxy 32m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dnvxk Stopping container istio-proxy 32m Normal SuccessfulDelete replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Deleted pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-pwbwv 32m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default Scaled down replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 7 to 6 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 6; reason: All metrics below target 32m Normal Created pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j Container created 32m Normal Started pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j Container started 32m Normal Pulled pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j Add eth0 [10.133.0.158/23] from ovn-kubernetes 32m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Container started 32m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Container created 32m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Add eth0 [10.133.0.157/23] from ovn-kubernetes 32m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Container created 32m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Container started 32m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Add eth0 [10.132.0.213/23] from ovn-kubernetes 32m Normal Started pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Container started 32m Normal Created pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Container created 32m Normal Pulled pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Add eth0 [10.132.0.212/23] from ovn-kubernetes 32m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused... 32m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused 32m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused 32m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused 32m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused... 32m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused... 32m Normal AddedLabel gateway/e2e-inf-b-0a7343 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-0a7343 32m Normal SuccessfulCreate replicaset/e2e-inf-b-0a7343-openshift-default-74585db445 Created pod: e2e-inf-b-0a7343-openshift-default-74585db445-lplwl 32m Normal ScalingReplicaSet deployment/e2e-inf-b-0a7343-openshift-default Scaled up replica set e2e-inf-b-0a7343-openshift-default-74585db445 from 0 to 1 32m Normal SuccessfulCreate replicaset/e2e-inf-b-f817b0-openshift-default-64d96d4677 Created pod: e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-f817b0-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 32m Normal ScalingReplicaSet deployment/e2e-inf-b-f817b0-openshift-default Scaled up replica set e2e-inf-b-f817b0-openshift-default-64d96d4677 from 1 to 2 32m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-27d3ad-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 32m Normal ScalingReplicaSet deployment/e2e-inf-b-facc79-openshift-default Scaled up replica set e2e-inf-b-facc79-openshift-default-5bdf4749c9 from 1 to 2 32m Normal SuccessfulCreate replicaset/e2e-inf-b-facc79-openshift-default-5bdf4749c9 Created pod: e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-facc79-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 32m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 6; reason: All metrics below target 32m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled down replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 7 to 6 32m Normal SuccessfulDelete replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Deleted pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p 32m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-cwp8p Stopping container istio-proxy 31m Normal AddedInterface pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Add eth0 [10.133.0.161/23] from ovn-kubernetes 31m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-0a7343-7969d5fd9d Error creating: pods "payload-processing-e2e-inf-b-0a7343-7969d5fd9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0a7343: serviceaccount "payload-processing-e2e-inf-b-0a7343" not found 31m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-0a7343-7969d5fd9d Created pod: payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk 31m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-0a7343 Scaled up replica set payload-processing-e2e-inf-b-0a7343-7969d5fd9d from 0 to 1 31m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f Created pod: payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm 31m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-0a7343 Scaled up replica set payload-pre-processing-e2e-inf-b-0a7343-cf5db545f from 0 to 1 31m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f Error creating: pods "payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-0a7343: serviceaccount "payload-processing-e2e-inf-b-0a7343" not found 31m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm Add eth0 [10.133.0.163/23] from ovn-kubernetes 31m Normal Pulled pod/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 31m Normal Created pod/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm Container created 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-27d3ad-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 31m Normal Started pod/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm Container started 31m Normal SuccessfulDelete replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Deleted pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 7; reason: All metrics below target 31m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkj7f Stopping container istio-proxy 31m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled down replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 8 to 7 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 6; reason: All metrics below target 31m Normal SuccessfulDelete replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Deleted pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 31m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled down replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 7 to 6 31m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Stopping container istio-proxy 31m Normal Pulled pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 31m Normal Created pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk Container created 31m Normal AddedInterface pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk Add eth0 [10.134.0.142/23] from ovn-kubernetes 31m Normal Started pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk Container started 31m Normal Pulled pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 31m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-dlf65 Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 31m Normal AddedInterface pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Add eth0 [10.132.0.214/23] from ovn-kubernetes 31m Normal Created pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Container created 31m Normal Started pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Container started 31m Warning ProbeError pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused... 31m Warning Unhealthy pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused 31m Normal Killing pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Stopping container payload-pre-processing 31m Normal Killing pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Stopping container payload-processing 31m Warning ProbeError pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Readiness probe error: Get "http://10.133.0.156:15021/healthz/ready": read tcp 10.133.0.2:37540->10.133.0.156:15021: read: connection reset by peer... 31m Warning Unhealthy pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Readiness probe failed: Get "http://10.133.0.156:15021/healthz/ready": read tcp 10.133.0.2:37540->10.133.0.156:15021: read: connection reset by peer 31m Normal Created pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Container created 31m Normal Pulled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Started pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Container started 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-46c34c-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 31m Normal SuccessfulCreate replicaset/e2e-inf-a-46c34c-openshift-default-5cc965c4d9 Created pod: e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl 31m Normal ScalingReplicaSet deployment/e2e-inf-a-46c34c-openshift-default Scaled up replica set e2e-inf-a-46c34c-openshift-default-5cc965c4d9 from 1 to 4 31m Normal SuccessfulCreate replicaset/e2e-inf-a-46c34c-openshift-default-5cc965c4d9 Created pod: e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc 31m Normal SuccessfulCreate replicaset/e2e-inf-a-46c34c-openshift-default-5cc965c4d9 Created pod: e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn 31m Normal Killing pod/e2e-inf-a-49fb2b-openshift-default-569f598477-sxdb5 Stopping container istio-proxy 31m Normal Killing pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Stopping container istio-proxy 31m Normal Killing pod/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 Stopping container payload-processing 31m Normal Killing pod/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms Stopping container payload-pre-processing 31m Warning ProbeError pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Readiness probe error: HTTP probe failed with statuscode: 503... 31m Warning Unhealthy pod/e2e-inf-a-49fb2b-openshift-default-569f598477-7gzrv Readiness probe failed: HTTP probe failed with statuscode: 503 31m Warning ProbeError pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Startup probe error: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused... 31m Warning Unhealthy pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Startup probe failed: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused 31m Warning Unhealthy pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 31m Normal Pulled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Add eth0 [10.132.0.215/23] from ovn-kubernetes 31m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 31m Normal Created pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Container created 31m Normal Started pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Container started 31m Normal AddedInterface pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Add eth0 [10.133.0.169/23] from ovn-kubernetes 31m Normal Started pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Container started 31m Normal Created pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Container created 31m Normal Pulled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal SuccessfulDelete replicaset/e2e-shared-a-w1-d81d18-openshift-default-66479b569c Deleted pod: e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt 31m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-d81d18-openshift-default Scaled down replica set e2e-shared-a-w1-d81d18-openshift-default-66479b569c from 3 to 2 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w1-d81d18-openshift-default New size: 2; reason: All metrics below target 31m Normal Killing pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-rdhkt Stopping container istio-proxy 31m Normal Killing pod/payload-pre-processing-e2e-inf-b-facc79-5ddbdd97dc-6m6qx Stopping container payload-pre-processing 31m Normal Killing pod/payload-processing-e2e-inf-b-facc79-6b465554d4-h46pw Stopping container payload-processing 31m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-46c34c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 31m Warning ProbeError pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Startup probe error: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused... 31m Warning Unhealthy pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Startup probe failed: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused 31m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-46c34c-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 31m Warning ProbeError pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused... 31m Warning Unhealthy pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused 31m Normal ScalingReplicaSet deployment/e2e-inf-a-43b780-openshift-default Scaled down replica set e2e-inf-a-43b780-openshift-default-5976c46f47 from 2 to 1 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-43b780-openshift-default New size: 1; reason: All metrics below target 31m Normal SuccessfulDelete replicaset/e2e-inf-a-43b780-openshift-default-5976c46f47 Deleted pod: e2e-inf-a-43b780-openshift-default-5976c46f47-7pcns 31m Normal Created pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Container created 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 5; reason: All metrics below target 31m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default Scaled down replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 7 to 6 31m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l Stopping container istio-proxy 31m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default Scaled down replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 6 to 5 31m Normal SuccessfulDelete replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Deleted pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m 31m Normal Started pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Container started 31m Normal Created pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Container created 31m Warning Unhealthy pod/payload-processing-e2e-inf-a-49fb2b-64ccbf5774-m6c8t Readiness probe failed: timeout: failed to connect service "10.132.0.192:50052" within 1s: context deadline exceeded 31m Normal Pulled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal SuccessfulDelete replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Deleted pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-96x6l 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 6; reason: All metrics below target 31m Normal Started pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Container started 31m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-hcd9m Stopping container istio-proxy 31m Normal Pulled pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Add eth0 [10.132.0.217/23] from ovn-kubernetes 31m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-49fb2b-86d58458bc-plfws Readiness probe failed: timeout: failed to connect service "10.132.0.191:50052" within 1s: context deadline exceeded 31m Normal AddedInterface pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Add eth0 [10.132.0.216/23] from ovn-kubernetes 31m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp Stopping container istio-proxy 31m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Stopping container istio-proxy 31m Normal SuccessfulDelete replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Deleted pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq 31m Normal SuccessfulDelete replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Deleted pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq 31m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-grkqq Stopping container istio-proxy 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default New size: 5; reason: All metrics below target 31m Normal SuccessfulDelete replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Deleted pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-sbkvp 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 6; reason: All metrics below target 31m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default New size: 5; reason: All metrics below target 31m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default Scaled down replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 7 to 6 31m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Readiness probe failed: HTTP probe failed with statuscode: 503 31m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-sltgq Readiness probe error: HTTP probe failed with statuscode: 503... 30m Normal AddedInterface pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Add eth0 [10.133.0.174/23] from ovn-kubernetes 30m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-43b780-cd6fc9f6c-ftdms Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 30m Warning ProbeError pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Startup probe error: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Startup probe failed: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused 30m Warning Unhealthy pod/payload-processing-e2e-inf-a-43b780-b75f87544-ghs92 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 30m Warning ProbeError pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Startup probe error: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Startup probe failed: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused 30m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-27d3ad Scaled up replica set payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455 from 0 to 1 30m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455 Created pod: payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs 30m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4 Created pod: payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx 30m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-27d3ad Scaled up replica set payload-processing-e2e-inf-b-27d3ad-5449b4d7d4 from 0 to 1 30m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4 Error creating: pods "payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-27d3ad: serviceaccount "payload-processing-e2e-inf-b-27d3ad" not found 30m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455 Error creating: pods "payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-27d3ad: serviceaccount "payload-processing-e2e-inf-b-27d3ad" not found 30m Normal Pulled pod/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal Started pod/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx Container started 30m Normal AddedInterface pod/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx Add eth0 [10.132.0.219/23] from ovn-kubernetes 30m Normal Created pod/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx Container created 30m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs Add eth0 [10.132.0.218/23] from ovn-kubernetes 30m Normal Pulled pod/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 30m Normal Created pod/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs Container created 30m Normal Started pod/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs Container started 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-46c34c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-46c34c-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled down replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 5 to 3 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default New size: 3; reason: All metrics below target 30m Normal SuccessfulDelete replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Deleted pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn 30m Normal SuccessfulDelete replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 Deleted pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p 30m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-v45zn Stopping container istio-proxy 30m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-t84tl Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-b-facc79-openshift-default-5bdf4749c9-2l2wh Stopping container istio-proxy 30m Normal SuccessfulDelete replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Deleted pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 30m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-wtvs7 Stopping container istio-proxy 30m Warning ProbeError pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Readiness probe error: HTTP probe failed with statuscode: 503... 30m Normal SuccessfulDelete replicaset/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 Deleted pod: e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 30m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb Stopping container istio-proxy 30m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Readiness probe error: HTTP probe failed with statuscode: 503... 30m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-q8l8p Readiness probe failed: HTTP probe failed with statuscode: 503 30m Normal ScalingReplicaSet deployment/e2e-worker-w4-5348ca-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5 from 5 to 4 30m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-bmw22 Stopping container istio-proxy 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default New size: 5; reason: All metrics below target 30m Normal SuccessfulDelete replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Deleted pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 30m Normal SuccessfulDelete replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Deleted pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-978hb 30m Warning Unhealthy pod/e2e-inf-a-43b780-openshift-default-5976c46f47-jx5mw Readiness probe failed: HTTP probe failed with statuscode: 503 30m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-vlkg9 Stopping container istio-proxy 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-5348ca-openshift-default New size: 4; reason: All metrics below target 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default New size: 5; reason: All metrics below target 30m Normal SuccessfulDelete replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Deleted pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l 30m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Stopping container istio-proxy 30m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-8vp8l Stopping container istio-proxy 30m Normal SuccessfulDelete replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Deleted pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt 30m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Stopping container istio-proxy 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 5; reason: All metrics below target 30m Normal SuccessfulDelete replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Deleted pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 30m Normal SuccessfulDelete replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Deleted pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m 30m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-57zg8 Stopping container istio-proxy 30m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default Scaled down replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 6 to 5 30m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-8r7bt Readiness probe error: HTTP probe failed with statuscode: 503... 30m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 5 to 4 30m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-9cmmw Stopping container discovery 30m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 4; reason: All metrics below target 30m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-9cmmw 30m Warning Unhealthy pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning ProbeError pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-vj76m Readiness probe error: HTTP probe failed with statuscode: 503... 30m Normal Killing pod/payload-processing-e2e-inf-b-f817b0-759b8969db-rs54v Stopping container payload-processing 30m Normal Killing pod/payload-processing-e2e-inf-a-2c6c50-5d96ff4bb6-csn7n Stopping container payload-processing 30m Normal Killing pod/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk Stopping container payload-pre-processing 30m Normal Killing pod/payload-pre-processing-e2e-inf-a-2c6c50-68444fbcd7-kgqvf Stopping container payload-pre-processing 30m Normal SuccessfulDelete replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Deleted pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg 30m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-9txlg Stopping container istio-proxy 30m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 Stopping container istio-proxy 30m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-b87733-openshift-default (combined from similar events): New size: 4; reason: All metrics below target 30m Normal ScalingReplicaSet deployment/e2e-worker-w3-b87733-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w3-b87733-openshift-default-989c6f4f5 from 5 to 4 30m Normal SuccessfulDelete replicaset/e2e-worker-w3-b87733-openshift-default-989c6f4f5 Deleted pod: e2e-worker-w3-b87733-openshift-default-989c6f4f5-6hxv6 30m Normal Pulled pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 30m Normal Started pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Container started 30m Normal Created pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Container created 30m Normal Killing pod/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 Stopping container payload-pre-processing 30m Normal Killing pod/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt Stopping container payload-processing 30m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-0a7343-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-0a7343-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-wk6gc Stopping container istio-proxy 30m Normal Killing pod/payload-processing-e2e-inf-a-663013-848b6d9486-s696n Stopping container payload-processing 30m Normal Killing pod/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 Stopping container payload-pre-processing 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Stopping container istio-proxy 30m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-fs6r6 Readiness probe error: HTTP probe failed with statuscode: 503... 30m Normal Killing pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-h6j9q Stopping container istio-proxy 30m Normal Killing pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Stopping container istio-proxy 30m Warning ProbeError pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Startup probe error: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Startup probe failed: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused 30m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-tt2tk Readiness probe error: HTTP probe failed with statuscode: 503... 30m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-dv4dm Readiness probe error: HTTP probe failed with statuscode: 503... 30m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Readiness probe error: HTTP probe failed with statuscode: 503... 30m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-lv8f5 Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-mkdsg Readiness probe error: HTTP probe failed with statuscode: 503... 30m Normal Killing pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Stopping container istio-proxy 30m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Readiness probe failed: Get "http://10.132.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 30m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-95x7f Readiness probe error: Get "http://10.132.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 30m Warning Unhealthy pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Readiness probe failed: Get "http://10.132.0.213:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 30m Warning ProbeError pod/e2e-inf-a-2c6c50-openshift-default-6f8d9f9f77-djv8j Readiness probe error: Get "http://10.132.0.213:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 30m Warning ProbeError pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Readiness probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused... 30m Warning Unhealthy pod/e2e-inf-b-f817b0-openshift-default-64d96d4677-98tck Readiness probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused 30m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-f817b0-8784455dc-kv8tk Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 30m Warning Unhealthy pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Readiness probe failed: HTTP probe failed with statuscode: 503 30m Warning ProbeError pod/e2e-inf-a-2092ba-openshift-default-5dd4c7f4dc-w46md Readiness probe error: HTTP probe failed with statuscode: 503... 30m Normal Killing pod/payload-processing-e2e-worker-w4-5348ca-87b665cfd-wjfgb Stopping container payload-processing 30m Normal Killing pod/payload-pre-processing-e2e-worker-w4-5348ca-7f46f69df9-hftbx Stopping container payload-pre-processing 30m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-2092ba-5495d58799-bxvt4 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 30m Warning Unhealthy pod/payload-processing-e2e-inf-a-2092ba-645468456d-bstpt Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 30m Normal Killing pod/e2e-inf-a-663013-openshift-default-8678b5b749-2rsrz Stopping container istio-proxy 30m Normal Killing pod/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 Stopping container payload-processing 30m Normal Killing pod/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd Stopping container payload-pre-processing 30m Warning Unhealthy pod/payload-processing-e2e-inf-a-663013-848b6d9486-s696n Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 30m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-663013-56888c558c-w6kx7 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 29m Normal Killing pod/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq Stopping container payload-processing 29m Normal Killing pod/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz Stopping container payload-pre-processing 29m Normal Killing pod/e2e-inf-b-9b1aed-openshift-default-69b65857d9-q4pvw Stopping container istio-proxy 29m Normal ScalingReplicaSet deployment/e2e-shared-a-w3-9ff9f5-openshift-default Scaled up replica set e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7 from 0 to 1 29m Normal AddedLabel gateway/e2e-shared-a-w3-9ff9f5 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-9ff9f5 29m Normal SuccessfulCreate replicaset/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7 Created pod: e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb 29m Normal AddedInterface pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Add eth0 [10.133.0.177/23] from ovn-kubernetes 29m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5 Error creating: pods "payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9ff9f5: serviceaccount "payload-processing-e2e-shared-a-w3-9ff9f5" not found 29m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6 Error creating: pods "payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9ff9f5: serviceaccount "payload-processing-e2e-shared-a-w3-9ff9f5" not found 29m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5 Created pod: payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 29m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6 Created pod: payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r 29m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w3-9ff9f5 Scaled up replica set payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5 from 0 to 1 29m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w3-9ff9f5 Scaled up replica set payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6 from 0 to 1 29m Normal Started pod/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 Container started 29m Normal Created pod/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 Container created 29m Normal Pulled pod/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r Add eth0 [10.133.0.179/23] from ovn-kubernetes 29m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 Add eth0 [10.133.0.178/23] from ovn-kubernetes 29m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-9b1aed-df66ffd87-rvlcd Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 29m Warning Unhealthy pod/payload-processing-e2e-inf-b-9b1aed-56586c9b6-rrvz5 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 29m Normal Started pod/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r Container started 29m Normal Created pod/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r Container created 29m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4mf Stopping container istio-proxy 29m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Stopping container istio-proxy 29m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-vnfch Stopping container istio-proxy 29m Normal Killing pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-5t4rm Stopping container istio-proxy 29m Normal Killing pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Stopping container istio-proxy 29m Normal Killing pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-c68l6 Stopping container istio-proxy 29m Normal AddedLabel gateway/e2e-shared-a-w2-456f55 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-456f55 29m Normal ScalingReplicaSet deployment/e2e-shared-a-w2-456f55-openshift-default Scaled up replica set e2e-shared-a-w2-456f55-openshift-default-5b9574668f from 0 to 1 29m Normal SuccessfulCreate replicaset/e2e-shared-a-w2-456f55-openshift-default-5b9574668f Created pod: e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f 29m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-0a7343-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-0a7343-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Normal AddedInterface pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Add eth0 [10.132.0.231/23] from ovn-kubernetes 29m Warning Unhealthy pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Readiness probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused 29m Warning ProbeError pod/e2e-worker-w4-5348ca-openshift-default-5b8f4c95d5-w2x8q Readiness probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused... 29m Warning ProbeError pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Readiness probe error: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 29m Warning Unhealthy pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Readiness probe failed: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 29m Warning Unhealthy pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Readiness probe failed: HTTP probe failed with statuscode: 503 29m Warning ProbeError pod/e2e-inf-b-babea4-openshift-default-5d69cb64f9-cjcxz Readiness probe error: HTTP probe failed with statuscode: 503... 29m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-babea4-6464c57675-xsvxz Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 29m Warning Unhealthy pod/payload-processing-e2e-inf-b-babea4-69dd894f84-vwzdq Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 29m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Container created 29m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Container started 29m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w2-456f55-76868f5c98 Error creating: pods "payload-processing-e2e-shared-a-w2-456f55-76868f5c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-456f55: serviceaccount "payload-processing-e2e-shared-a-w2-456f55" not found 29m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w2-456f55-76868f5c98 Created pod: payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg 29m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w2-456f55 Scaled up replica set payload-processing-e2e-shared-a-w2-456f55-76868f5c98 from 0 to 1 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 29m Normal Pulled pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff Error creating: pods "payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-456f55: serviceaccount "payload-processing-e2e-shared-a-w2-456f55" not found 29m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff Created pod: payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg 29m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled up replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 3 to 4 29m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w2-456f55 Scaled up replica set payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff from 0 to 1 29m Normal Started pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Container started 29m Normal Created pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Container created 29m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Add eth0 [10.133.0.180/23] from ovn-kubernetes 29m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-27d3ad-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 29m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Container started 29m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Container created 29m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg Add eth0 [10.133.0.181/23] from ovn-kubernetes 29m Normal Pulled pod/payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg Add eth0 [10.133.0.182/23] from ovn-kubernetes 29m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal Started pod/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg Container started 29m Normal Started pod/payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg Container started 29m Normal Created pod/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg Container created 29m Normal Created pod/payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg Container created 29m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk Stopping container istio-proxy 29m Normal SuccessfulDelete replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Deleted pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-kgjrk 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default New size: 4; reason: All metrics below target 29m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused 29m Warning ProbeError pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused... 29m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused... 29m Warning Unhealthy pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused 29m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused... 29m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused 29m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w3-9ff9f5-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 29m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w3-9ff9f5-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 29m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w6-ee2323-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w6-ee2323-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 29m Normal SuccessfulCreate replicaset/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf Created pod: e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d 29m Normal AddedLabel gateway/e2e-shared-b-w3-a8e19e Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-a8e19e 29m Normal ScalingReplicaSet deployment/e2e-shared-b-w3-a8e19e-openshift-default Scaled up replica set e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf from 0 to 1 29m Normal AddedInterface pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Add eth0 [10.133.0.183/23] from ovn-kubernetes 29m Normal SuccessfulCreate replicaset/e2e-inf-b-0a7343-openshift-default-74585db445 Created pod: e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl 29m Normal ScalingReplicaSet deployment/e2e-inf-b-0a7343-openshift-default Scaled up replica set e2e-inf-b-0a7343-openshift-default-74585db445 from 1 to 2 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-0a7343-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 29m Normal Started pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Container started 29m Normal AddedInterface pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Add eth0 [10.132.0.232/23] from ovn-kubernetes 29m Normal Pulled pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal Created pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Container created 29m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w3-a8e19e Scaled up replica set payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd from 0 to 1 29m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w3-a8e19e Scaled up replica set payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495 from 0 to 1 29m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495 Created pod: payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww 29m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495 Error creating: pods "payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a8e19e: serviceaccount "payload-processing-e2e-shared-b-w3-a8e19e" not found 29m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd Created pod: payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 29m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd Error creating: pods "payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a8e19e: serviceaccount "payload-processing-e2e-shared-b-w3-a8e19e" not found 29m Normal Started pod/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 Container started 29m Normal Started pod/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww Container started 29m Normal Pulled pod/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww Add eth0 [10.133.0.184/23] from ovn-kubernetes 29m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal Created pod/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 Container created 29m Normal AddedInterface pod/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 Add eth0 [10.132.0.233/23] from ovn-kubernetes 29m Normal Created pod/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww Container created 29m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 29m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc 29m Normal AddedLabel gateway/e2e-shared-b-w2-b55105 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b55105 29m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Add eth0 [10.133.0.185/23] from ovn-kubernetes 29m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Add eth0 [10.134.0.151/23] from ovn-kubernetes 29m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w6-ee2323-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 29m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s 29m Normal ScalingReplicaSet deployment/e2e-shared-a-w6-ee2323-openshift-default Scaled up replica set e2e-shared-a-w6-ee2323-openshift-default-855486c599 from 1 to 4 29m Normal SuccessfulCreate replicaset/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9 Created pod: e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 29m Normal ScalingReplicaSet deployment/e2e-shared-b-w2-b55105-openshift-default Scaled up replica set e2e-shared-b-w2-b55105-openshift-default-df8cb58b9 from 0 to 1 29m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Add eth0 [10.132.0.234/23] from ovn-kubernetes 29m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Container started 29m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Container created 29m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Container started 29m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Container started 29m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Container created 29m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Container created 29m Normal AddedInterface pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Add eth0 [10.132.0.235/23] from ovn-kubernetes 29m Warning Unhealthy pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused 29m Warning ProbeError pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused... 29m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w2-b55105 Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7 from 0 to 1 29m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w2-b55105-5888d84df4 Error creating: pods "payload-processing-e2e-shared-b-w2-b55105-5888d84df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b55105: serviceaccount "payload-processing-e2e-shared-b-w2-b55105" not found 29m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w2-b55105-5888d84df4 Created pod: payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss 29m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7 Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b55105: serviceaccount "payload-processing-e2e-shared-b-w2-b55105" not found 29m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7 Created pod: payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb 29m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w2-b55105 Scaled up replica set payload-processing-e2e-shared-b-w2-b55105-5888d84df4 from 0 to 1 29m Normal Started pod/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb Container started 29m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb Add eth0 [10.132.0.236/23] from ovn-kubernetes 29m Normal Created pod/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb Container created 29m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused... 29m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal Pulled pod/payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 29m Normal Created pod/payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss Container created 29m Normal AddedInterface pod/payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss Add eth0 [10.133.0.186/23] from ovn-kubernetes 29m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused 29m Normal Started pod/payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss Container started 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Startup probe failed: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Startup probe error: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused... 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused 28m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Add eth0 [10.133.0.187/23] from ovn-kubernetes 28m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr 28m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx 28m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Container started 28m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Container created 28m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Container started 28m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Add eth0 [10.134.0.152/23] from ovn-kubernetes 28m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 28m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Container created 28m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w6-ee2323-openshift-default New size: 8; reason: 28m Normal ScalingReplicaSet deployment/e2e-shared-a-w6-ee2323-openshift-default Scaled up replica set e2e-shared-a-w6-ee2323-openshift-default-855486c599 from 4 to 8 28m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk 28m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Add eth0 [10.132.0.238/23] from ovn-kubernetes 28m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Container started 28m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Container started 28m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Container created 28m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Container created 28m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Add eth0 [10.132.0.237/23] from ovn-kubernetes 28m Warning Unhealthy pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Readiness probe failed: Get "http://10.133.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 28m Warning ProbeError pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Readiness probe error: Get "http://10.133.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 28m Normal Created pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Container created 28m Normal Pulled pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Container started 28m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc Created pod: e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm 28m Normal AddedInterface pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Add eth0 [10.134.0.154/23] from ovn-kubernetes 28m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc Created pod: e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 28m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc Created pod: e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w0-a476f8-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 28m Normal ScalingReplicaSet deployment/e2e-shared-b-w0-a476f8-openshift-default Scaled up replica set e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc from 1 to 4 28m Normal Pulled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Container started 28m Normal Pulled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Container started 28m Normal Created pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Container created 28m Normal Started pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Container started 28m Normal Created pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Container created 28m Normal AddedInterface pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Add eth0 [10.133.0.188/23] from ovn-kubernetes 28m Normal Created pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Container created 28m Normal Pulled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Add eth0 [10.133.0.189/23] from ovn-kubernetes 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Startup probe failed: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Startup probe failed: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Startup probe error: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused... 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Startup probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Startup probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Startup probe error: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused... 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Readiness probe error: Get "http://10.132.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Startup probe failed: Get "http://10.132.0.238:15021/healthz/ready": dial tcp 10.132.0.238:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Startup probe error: Get "http://10.132.0.238:15021/healthz/ready": dial tcp 10.132.0.238:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Readiness probe failed: Get "http://10.132.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused... 28m Warning ProbeError pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused... 28m Warning ProbeError pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Readiness probe error: Get "http://10.132.0.231:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 28m Warning Unhealthy pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Readiness probe failed: Get "http://10.132.0.231:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 28m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Container created 28m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w2-b55105-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w6-ee2323-openshift-default New size: 10; reason: 28m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Container started 28m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal ScalingReplicaSet deployment/e2e-shared-a-w6-ee2323-openshift-default Scaled up replica set e2e-shared-a-w6-ee2323-openshift-default-855486c599 from 8 to 10 28m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd 28m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w2-b55105-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Add eth0 [10.134.0.156/23] from ovn-kubernetes 28m Normal SuccessfulCreate replicaset/e2e-shared-a-w6-ee2323-openshift-default-855486c599 Created pod: e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx 28m Normal Created pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Container created 28m Normal Started pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Container started 28m Normal Pulled pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Add eth0 [10.132.0.239/23] from ovn-kubernetes 28m Normal AddedInterface pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Add eth0 [10.133.0.190/23] from ovn-kubernetes 28m Normal ScalingReplicaSet deployment/e2e-shared-b-w0-a476f8-openshift-default Scaled up replica set e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc from 4 to 7 28m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc Created pod: e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w0-a476f8-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 28m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc Created pod: e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 28m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc Created pod: e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl 28m Normal AddedInterface pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Add eth0 [10.134.0.157/23] from ovn-kubernetes 28m Normal Created pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Container created 28m Normal Created pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Container created 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Startup probe error: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Startup probe failed: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused 28m Normal Pulled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Container started 28m Normal Created pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Container created 28m Normal Pulled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Container started 28m Normal AddedInterface pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Add eth0 [10.132.0.240/23] from ovn-kubernetes 28m Normal Started pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Container started 28m Normal Created pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Container created 28m Normal Pulled pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Pulled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Started pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Container started 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Readiness probe error: Get "http://10.132.0.179:15021/healthz/ready": read tcp 10.132.0.2:55408->10.132.0.179:15021: read: connection reset by peer... 28m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Startup probe error: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Startup probe failed: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Readiness probe failed: Get "http://10.132.0.179:15021/healthz/ready": read tcp 10.132.0.2:55408->10.132.0.179:15021: read: connection reset by peer 28m Normal Pulled pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal Created pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Container created 28m Normal Started pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Container started 28m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w2-456f55-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w2-456f55-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w6-0ffd89-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 28m Normal SuccessfulCreate replicaset/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5 Created pod: e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc 28m Normal ScalingReplicaSet deployment/e2e-shared-b-w6-0ffd89-openshift-default Scaled up replica set e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5 from 1 to 2 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused 28m Normal Pulled pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Add eth0 [10.133.0.192/23] from ovn-kubernetes 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Startup probe error: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused... 28m Normal Created pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Container created 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused... 28m Normal Started pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Container started 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Startup probe failed: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Startup probe failed: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Startup probe error: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused... 28m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-fcb75c45f from 10 to 9 28m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-p994c 28m Warning Unhealthy pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Startup probe failed: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Startup probe error: Get "http://10.132.0.231:15021/healthz/ready": dial tcp 10.132.0.231:15021: connect: connection refused... 28m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 9; reason: All metrics below target 28m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Readiness probe failed: HTTP probe failed with statuscode: 503 28m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Readiness probe error: HTTP probe failed with statuscode: 503... 28m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-p994c Stopping container istio-proxy 28m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused 28m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused... 28m Warning ProbeError pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Startup probe error: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused... 28m Warning Unhealthy pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Startup probe failed: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused 28m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w0-a476f8-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w0-a476f8-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 28m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w3-9ff9f5-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 28m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w3-9ff9f5-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 28m Warning Unhealthy pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Readiness probe failed: Get "http://10.132.0.235:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 28m Warning ProbeError pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Readiness probe error: Get "http://10.132.0.235:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 28m Normal Started pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Container started 28m Normal Created pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Container created 28m Normal Pulled pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w2-456f55-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w2-456f55-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning ProbeError pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Startup probe error: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused... 27m Warning Unhealthy pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Startup probe failed: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused 27m Normal ScalingReplicaSet deployment/e2e-inf-a-46c34c-openshift-default Scaled up replica set e2e-inf-a-46c34c-openshift-default-5cc965c4d9 from 4 to 5 27m Normal SuccessfulCreate replicaset/e2e-inf-a-46c34c-openshift-default-5cc965c4d9 Created pod: e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g 27m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-a-46c34c-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 27m Normal AddedInterface pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Add eth0 [10.134.0.160/23] from ovn-kubernetes 27m Normal Created pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Container created 27m Normal Pulled pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 27m Normal Started pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Container started 27m Warning Unhealthy pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused 27m Warning ProbeError pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused... 27m Normal Pulled pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 27m Normal Started pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Container started 27m Normal Created pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Container created 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w3-a8e19e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w3-a8e19e-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 27m Normal Killing pod/payload-processing-e2e-shared-a-w3-9ff9f5-5487f6b6c6-6bj5r Stopping container payload-processing 27m Warning ProbeError pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused... 27m Normal Killing pod/payload-pre-processing-e2e-shared-a-w3-9ff9f5-56d4864bf5-5qj65 Stopping container payload-pre-processing 27m Warning Unhealthy pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused 27m Normal Killing pod/e2e-shared-a-w3-9ff9f5-openshift-default-6d6457fb7-g4bfb Stopping container istio-proxy 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w2-b55105-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w2-b55105-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Normal Killing pod/payload-processing-e2e-shared-b-w3-a8e19e-7b76756bfd-npjt8 Stopping container payload-processing 27m Normal Killing pod/payload-pre-processing-e2e-shared-b-w3-a8e19e-669f4bf495-z4hww Stopping container payload-pre-processing 27m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w3-a8e19e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 27m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w3-a8e19e-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 26m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled up replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 4 to 6 26m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 26m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Container started 26m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Add eth0 [10.134.0.161/23] from ovn-kubernetes 26m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Container started 26m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Add eth0 [10.132.0.243/23] from ovn-kubernetes 26m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Container created 26m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Container created 26m Normal Killing pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Stopping container istio-proxy 26m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused... 26m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused 26m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Startup probe failed: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused 26m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Startup probe error: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused... 26m Warning ProbeError pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Readiness probe error: HTTP probe failed with statuscode: 503... 26m Warning Unhealthy pod/e2e-shared-b-w3-a8e19e-openshift-default-5d9485bf-hp48d Readiness probe failed: HTTP probe failed with statuscode: 503 26m Normal Killing pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Stopping container payload-processing 26m Normal SuccessfulCreate replicaset/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9 Created pod: e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn 26m Normal Killing pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Stopping container payload-pre-processing 26m Normal ScalingReplicaSet deployment/e2e-shared-b-w2-b55105-openshift-default Scaled up replica set e2e-shared-b-w2-b55105-openshift-default-df8cb58b9 from 1 to 2 26m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w2-b55105-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 26m Normal Started pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Container started 26m Normal AddedInterface pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Add eth0 [10.133.0.194/23] from ovn-kubernetes 26m Normal Pulled pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 26m Normal Created pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Container created 26m Warning ProbeError pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused... 26m Warning Unhealthy pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused 26m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w3-b87733-747d96db47-wv2pc Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 26m Warning Unhealthy pod/payload-processing-e2e-worker-w3-b87733-9c5b7fdd-d4bsc Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 26m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-f4t8w Stopping container istio-proxy 26m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-t7bf2 Stopping container istio-proxy 26m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-p8c4w Stopping container istio-proxy 26m Normal Killing pod/e2e-worker-w3-b87733-openshift-default-989c6f4f5-5zp2s Stopping container istio-proxy 25m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w2-456f55-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 25m Normal ScalingReplicaSet deployment/e2e-shared-a-w2-456f55-openshift-default Scaled up replica set e2e-shared-a-w2-456f55-openshift-default-5b9574668f from 1 to 2 25m Normal Pulled pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 25m Normal SuccessfulCreate replicaset/e2e-shared-a-w2-456f55-openshift-default-5b9574668f Created pod: e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x 25m Normal AddedInterface pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Add eth0 [10.133.0.195/23] from ovn-kubernetes 25m Normal Created pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Container created 25m Normal Started pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Container started 25m Warning ProbeError pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Startup probe error: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused... 25m Warning Unhealthy pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Startup probe failed: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused 25m Normal SuccessfulCreate replicaset/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5 Created pod: e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn 25m Normal ScalingReplicaSet deployment/e2e-inf-b-27d3ad-openshift-default Scaled up replica set e2e-inf-b-27d3ad-openshift-default-85d7dd4c5 from 1 to 2 25m Normal SuccessfulRescale horizontalpodautoscaler/e2e-inf-b-27d3ad-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 25m Normal Started pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Container started 25m Normal Created pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Container created 25m Normal Pulled pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 25m Normal AddedInterface pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Add eth0 [10.132.0.254/23] from ovn-kubernetes 25m Normal Killing pod/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 Stopping container payload-pre-processing 25m Normal Killing pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j Stopping container payload-processing 24m Warning ProbeError pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Startup probe error: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused... 24m Warning Unhealthy pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Startup probe failed: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused 24m Normal Killing pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-qkzbc Stopping container istio-proxy 24m Normal Killing pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-j66w4 Stopping container istio-proxy 24m Normal Killing pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-jbb5g Stopping container istio-proxy 24m Normal Killing pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-q96rl Stopping container istio-proxy 24m Normal Killing pod/e2e-inf-a-46c34c-openshift-default-5cc965c4d9-w5ndn Stopping container istio-proxy 24m Normal Killing pod/payload-processing-e2e-shared-a-w6-ee2323-7889c4b54d-g98tt Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-shared-a-w6-ee2323-75ffb95c7f-sl6s2 Stopping container payload-pre-processing 24m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-46c34c-7bcc6dd867-86lf7 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Normal Killing pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm Stopping container payload-pre-processing 24m Warning Unhealthy pod/payload-processing-e2e-inf-a-46c34c-6bcdcf5f5d-t8p8j Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Normal Killing pod/payload-processing-e2e-shared-a-w0-cad531-5c6bf4fb9d-wzt8p Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-shared-a-w0-cad531-5758dcd487-mw5jb Stopping container payload-pre-processing 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-lsjs5 Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-4wgbx Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-8sg57 Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-zxv2s Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Stopping container istio-proxy 24m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl Stopping container istio-proxy 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-11a5b0-openshift-default (combined from similar events): New size: 3; reason: All metrics below target 24m Normal ScalingReplicaSet deployment/e2e-worker-w2-11a5b0-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w2-11a5b0-openshift-default-8569845457 from 4 to 3 24m Normal SuccessfulDelete replicaset/e2e-worker-w2-11a5b0-openshift-default-8569845457 Deleted pod: e2e-worker-w2-11a5b0-openshift-default-8569845457-jrkkl 24m Normal ScalingReplicaSet deployment/e2e-worker-w5-ab1e46-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf from 4 to 3 24m Normal SuccessfulDelete replicaset/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf Deleted pod: e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s 24m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-2hv5s Stopping container istio-proxy 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-ab1e46-openshift-default (combined from similar events): New size: 3; reason: All metrics below target 24m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Readiness probe error: HTTP probe failed with statuscode: 503... 24m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Readiness probe error: HTTP probe failed with statuscode: 503... 24m Normal Killing pod/e2e-inf-b-0a7343-openshift-default-74585db445-rsjjl Stopping container istio-proxy 24m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-hjcpd Readiness probe failed: HTTP probe failed with statuscode: 503 24m Normal Killing pod/e2e-inf-b-0a7343-openshift-default-74585db445-lplwl Stopping container istio-proxy 24m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-ntzdk Readiness probe failed: HTTP probe failed with statuscode: 503 24m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 3; reason: All metrics below target 24m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-lfrxk Stopping container discovery 24m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Readiness probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused... 24m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-tlklc Readiness probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused 24m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Readiness probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused... 24m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-752vk Readiness probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused 24m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-lfrxk 24m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3 24m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Readiness probe failed: Get "http://10.132.0.237:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 24m Warning Unhealthy pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Readiness probe failed: Get "http://10.132.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 24m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-mkdnr Readiness probe error: Get "http://10.132.0.237:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 24m Warning ProbeError pod/e2e-shared-a-w6-ee2323-openshift-default-855486c599-pnvwx Readiness probe error: Get "http://10.132.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 24m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-28w6h 24m Normal Killing pod/payload-processing-e2e-shared-b-w6-0ffd89-7d7dc89d8d-45gj5 Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-shared-b-w6-0ffd89-6cb465c8c9-m7rlt Stopping container payload-pre-processing 24m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-kpkjt Stopping container istio-proxy 24m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-fcb75c45f from 9 to 7 24m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 7; reason: All metrics below target 24m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-kpkjt 24m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-28w6h Stopping container istio-proxy 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w0-cad531-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 24m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 (combined from similar events): Created pod: e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc 24m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-cad531-openshift-default Scaled up replica set e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65 from 6 to 7 24m Normal Pulled pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 24m Normal Started pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Container started 24m Normal Created pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Container created 24m Normal AddedInterface pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Add eth0 [10.133.0.196/23] from ovn-kubernetes 24m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-47g7s Stopping container istio-proxy 24m Warning Unhealthy pod/payload-processing-e2e-inf-b-0a7343-7969d5fd9d-9plqk Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-l7szr Stopping container istio-proxy 24m Normal Killing pod/payload-processing-e2e-shared-a-w1-d81d18-5f89dd9858-hb8mq Stopping container payload-processing 24m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-mtzrj Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Stopping container istio-proxy 24m Normal Killing pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Stopping container payload-processing 24m Warning FailedToRetrieveImagePullSecret pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Unable to retrieve some image pull secrets (e2e-shared-a-w0-cad531-openshift-default-dockercfg-gj4fh); attempting to pull the image may not succeed. 24m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-0a7343-cf5db545f-tp5vm Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Normal Killing pod/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 Stopping container payload-pre-processing 24m Normal Killing pod/payload-pre-processing-e2e-shared-a-w1-d81d18-6448f949ff-pksjh Stopping container payload-pre-processing 24m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused 24m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Readiness probe failed: HTTP probe failed with statuscode: 503 24m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-n8t7w Readiness probe error: HTTP probe failed with statuscode: 503... 24m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused... 24m Normal Killing pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-97xwc Stopping container istio-proxy 24m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx Stopping container istio-proxy 24m Normal ScalingReplicaSet deployment/e2e-worker-w0-120fe3-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc from 4 to 3 24m Normal ScalingReplicaSet deployment/e2e-worker-w1-b42aea-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w1-b42aea-openshift-default-7964669b97 from 5 to 4 24m Normal SuccessfulDelete replicaset/e2e-worker-w1-b42aea-openshift-default-7964669b97 Deleted pod: e2e-worker-w1-b42aea-openshift-default-7964669b97-qcqlx 24m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Stopping container istio-proxy 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-b42aea-openshift-default (combined from similar events): New size: 4; reason: All metrics below target 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-120fe3-openshift-default (combined from similar events): New size: 3; reason: All metrics below target 24m Normal SuccessfulDelete replicaset/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc Deleted pod: e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-0ed729-openshift-default (combined from similar events): New size: 3; reason: All metrics below target 24m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Readiness probe error: HTTP probe failed with statuscode: 503... 24m Normal ScalingReplicaSet deployment/e2e-worker-w6-0ed729-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w6-0ed729-openshift-default-5b668fd6bc from 4 to 3 24m Normal Killing pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-9ft8v Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-b-w6-0ffd89-openshift-default-6d49fd96c5-6fnhc Stopping container istio-proxy 24m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj Stopping container istio-proxy 24m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-7wfhw Readiness probe failed: HTTP probe failed with statuscode: 503 24m Normal SuccessfulDelete replicaset/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc Deleted pod: e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-66mlj 24m Warning ProbeError pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Readiness probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused... 24m Warning Unhealthy pod/e2e-shared-a-w0-cad531-openshift-default-6bbdbd8f65-x2k28 Readiness probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused 24m Warning Unhealthy pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Readiness probe failed: HTTP probe failed with statuscode: 503 24m Warning ProbeError pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-96ms2 Readiness probe error: HTTP probe failed with statuscode: 503... 24m Normal Killing pod/payload-processing-e2e-shared-b-w0-a476f8-77865dd486-k8fzd Stopping container payload-processing 24m Normal Killing pod/payload-pre-processing-e2e-shared-b-w0-a476f8-79b98cfd5f-4mfzp Stopping container payload-pre-processing 24m Normal Killing pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Stopping container istio-proxy 24m Normal Killing pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Stopping container istio-proxy 24m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w2-b55105-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 24m Normal AddedInterface pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Add eth0 [10.134.0.162/23] from ovn-kubernetes 24m Normal Pulled pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 24m Normal Created pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Container created 24m Normal Killing pod/e2e-inf-a-22a567-openshift-default-ff7c86f85-ml6fw Stopping container istio-proxy 24m Normal SuccessfulCreate replicaset/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9 Created pod: e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h 24m Normal Started pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Container started 24m Normal ScalingReplicaSet deployment/e2e-shared-b-w2-b55105-openshift-default Scaled up replica set e2e-shared-b-w2-b55105-openshift-default-df8cb58b9 from 2 to 3 24m Normal Killing pod/payload-pre-processing-e2e-worker-w6-0ed729-68454bb49f-swsd5 Stopping container payload-pre-processing 24m Normal Killing pod/payload-processing-e2e-worker-w6-0ed729-d7bdd7f56-9cfnz Stopping container payload-processing 24m Warning Unhealthy pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 24m Warning ProbeError pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Readiness probe error: HTTP probe failed with statuscode: 503... 24m Warning Unhealthy pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-nhgsq Readiness probe failed: HTTP probe failed with statuscode: 503 24m Warning ProbeError pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Readiness probe error: HTTP probe failed with statuscode: 503... 24m Warning Unhealthy pod/e2e-shared-a-w1-d81d18-openshift-default-66479b569c-qxntp Readiness probe failed: HTTP probe failed with statuscode: 503 24m Warning ProbeError pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused... 24m Warning Unhealthy pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused 23m Normal Killing pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Stopping container istio-proxy 23m Normal Killing pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Stopping container istio-proxy 23m Normal Killing pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Stopping container istio-proxy 23m Normal Killing pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Stopping container istio-proxy 23m Normal Killing pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Stopping container istio-proxy 23m Normal Killing pod/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs Stopping container payload-pre-processing 23m Normal Killing pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-h84jx Stopping container istio-proxy 23m Normal Killing pod/payload-processing-e2e-inf-b-27d3ad-5449b4d7d4-8qmlx Stopping container payload-processing 23m Normal Killing pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Stopping container istio-proxy 23m Normal Killing pod/payload-processing-e2e-shared-b-w1-944e83-795689f8b-t6tph Stopping container payload-processing 23m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Readiness probe failed: HTTP probe failed with statuscode: 503 23m Normal Killing pod/payload-pre-processing-e2e-shared-b-w1-944e83-db6cbc767-62qqq Stopping container payload-pre-processing 23m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-j4q49 Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-mglgp Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-22a567-66dcddf555-np4j8 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-28hk9 Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/payload-processing-e2e-inf-a-22a567-766dc74f8-4jdck Readiness probe failed: timeout: failed to connect service "10.133.0.149:50052" within 1s: context deadline exceeded 23m Warning ProbeError pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-znjnm Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-htgdl Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning Unhealthy pod/e2e-shared-b-w0-a476f8-openshift-default-8dc54c4fc-l5jk2 Readiness probe failed: HTTP probe failed with statuscode: 503 23m Normal Killing pod/payload-pre-processing-e2e-worker-w0-120fe3-59798bf69f-c6dx2 Stopping container payload-pre-processing 23m Normal Killing pod/payload-processing-e2e-worker-w0-120fe3-564ff75dfb-hscr4 Stopping container payload-processing 23m Normal Killing pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-98tcl Stopping container istio-proxy 23m Normal Killing pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Stopping container istio-proxy 23m Normal Killing pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Stopping container istio-proxy 23m Warning Unhealthy pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-inf-b-27d3ad-openshift-default-85d7dd4c5-wrjgn Readiness probe error: HTTP probe failed with statuscode: 503... 23m Normal Killing pod/payload-pre-processing-e2e-shared-a-w2-456f55-5898c984ff-9w9bg Stopping container payload-pre-processing 23m Normal Killing pod/payload-processing-e2e-shared-a-w2-456f55-76868f5c98-z9kwg Stopping container payload-processing 23m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-52rzs Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Stopping container istio-proxy 23m Warning ProbeError pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/e2e-shared-b-w1-944e83-openshift-default-857fc7f84f-pb6gc Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-8mrhv Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning ProbeError pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/e2e-worker-w6-0ed729-openshift-default-5b668fd6bc-bngss Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-27d3ad-596dfb9455-9hlzs Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Normal Killing pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Stopping container payload-processing 23m Normal Killing pod/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 Stopping container payload-pre-processing 23m Normal Killing pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Stopping container payload-pre-processing 23m Normal Killing pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-d5b7f Stopping container istio-proxy 23m Normal Killing pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Stopping container payload-processing 23m Normal Killing pod/e2e-shared-a-w2-456f55-openshift-default-5b9574668f-dkx8x Stopping container istio-proxy 23m Normal Killing pod/payload-processing-e2e-shared-b-w2-b55105-5888d84df4-bk4ss Stopping container payload-processing 23m Normal Killing pod/payload-pre-processing-e2e-shared-b-w2-b55105-cfb4766d7-gvplb Stopping container payload-pre-processing 23m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-dj248 Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-z8f5z Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w0-120fe3-openshift-default-cdb9b5cdc-qcm6z Stopping container istio-proxy 23m Warning Unhealthy pod/payload-processing-e2e-worker-w1-b42aea-5b857c86-d7swj Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w5-ab1e46-5cb56fc799-8lk69 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Normal Killing pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-g426h Stopping container istio-proxy 23m Normal Killing pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Stopping container istio-proxy 23m Warning Unhealthy pod/payload-processing-e2e-worker-w5-ab1e46-57c8758d5d-gzwb6 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Normal Killing pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-zg8nn Stopping container istio-proxy 23m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w1-b42aea-65b5c44c55-zgh9j Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 23m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Readiness probe error: HTTP probe failed with statuscode: 503... 23m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Stopping container istio-proxy 23m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-rhtcv Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-ss7mh Readiness probe error: HTTP probe failed with statuscode: 503... 23m Warning Unhealthy pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-shared-b-w2-b55105-openshift-default-df8cb58b9-4h4w8 Readiness probe error: HTTP probe failed with statuscode: 503... 23m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-nkqnh Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-42z8m Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-xr8cw Stopping container istio-proxy 23m Normal Killing pod/e2e-worker-w1-b42aea-openshift-default-7964669b97-lsdd7 Stopping container istio-proxy 23m Warning Unhealthy pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Readiness probe failed: HTTP probe failed with statuscode: 503 23m Warning ProbeError pod/e2e-worker-w5-ab1e46-openshift-default-568c5c7fbf-hzf7k Readiness probe error: HTTP probe failed with statuscode: 503... 23m Normal Killing pod/payload-pre-processing-e2e-worker-w2-11a5b0-5b9765647f-2p5zd Stopping container payload-pre-processing 23m Normal Killing pod/payload-processing-e2e-worker-w2-11a5b0-6f4777d64b-hsxnd Stopping container payload-processing 22m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Stopping container istio-proxy 22m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-frxxl Stopping container istio-proxy 22m Normal Killing pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-jrvcp Stopping container istio-proxy 22m Warning Unhealthy pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Readiness probe failed: HTTP probe failed with statuscode: 503 22m Warning ProbeError pod/e2e-worker-w2-11a5b0-openshift-default-8569845457-2bn5s Readiness probe error: HTTP probe failed with statuscode: 503... 22m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-45b2b 22m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-vbhfd 22m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-fcb75c45f from 7 to 10 22m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-cwz84 22m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 22m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Container created 22m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Add eth0 [10.133.0.198/23] from ovn-kubernetes 22m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Container created 22m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Container started 22m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Add eth0 [10.134.0.166/23] from ovn-kubernetes 22m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Container started 22m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Add eth0 [10.133.0.199/23] from ovn-kubernetes 22m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Container created 22m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Container started 22m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused... 22m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused 22m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused 22m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Startup probe error: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused... 22m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused... 22m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Startup probe failed: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused 18m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-qrs7z 18m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Stopping container discovery 18m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Readiness probe error: Get "http://10.134.0.85:8080/ready": dial tcp 10.134.0.85:8080: connect: connection refused... 18m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-qrs7z Readiness probe failed: Get "http://10.134.0.85:8080/ready": dial tcp 10.134.0.85:8080: connect: connection refused 18m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2 18m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 2; reason: All metrics below target 18m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Readiness probe error: Get "http://10.133.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 18m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Readiness probe failed: Get "http://10.133.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 18m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Readiness probe failed: Get "http://10.134.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 18m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Readiness probe error: Get "http://10.134.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 18m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Readiness probe error: Get "http://10.133.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 18m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Readiness probe failed: Get "http://10.133.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 17m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 1; reason: All metrics below target 17m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1 17m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-vk8mm 17m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-vk8mm Stopping container discovery 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-cwz84 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-45b2b Stopping container istio-proxy 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-45b2b 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Stopping container istio-proxy 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-gmqdl 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-rrs66 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-vbhfd 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Stopping container istio-proxy 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-sk7xk 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Stopping container istio-proxy 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-4vnbx 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Stopping container istio-proxy 12m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-fcb75c45f from 10 to 1 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-2n8gb 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Stopping container istio-proxy 12m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 1; reason: All metrics below target 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-cwz84 Stopping container istio-proxy 12m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-fcb75c45f Deleted pod: maas-default-gateway-openshift-default-fcb75c45f-7krc7 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Stopping container istio-proxy 12m Normal Killing pod/maas-default-gateway-openshift-default-fcb75c45f-vbhfd Stopping container istio-proxy 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Readiness probe error: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-7krc7 Readiness probe failed: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-rrs66 Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Readiness probe error: Get "http://10.133.0.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-2n8gb Readiness probe failed: Get "http://10.133.0.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-h7vtl Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-gmqdl Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-4vnbx Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-sk7xk Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 12m Normal SuccessfulCreate replicaset/e2e-worker-single-main-4442a4-openshift-default-b7d765c97 Created pod: e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h 12m Normal ScalingReplicaSet deployment/e2e-worker-single-main-4442a4-openshift-default Scaled up replica set e2e-worker-single-main-4442a4-openshift-default-b7d765c97 from 0 to 1 12m Normal AddedLabel gateway/e2e-worker-single-main-4442a4 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-4442a4 12m Normal AddedInterface pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Add eth0 [10.133.0.201/23] from ovn-kubernetes 12m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-8bcwd 12m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-single-main-4442a4 Scaled up replica set payload-pre-processing-e2e-worker-single-main-4442a4-7658d9667 from 0 to 1 12m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-single-main-4442a4-7cff98b6b Created pod: payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d 12m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-single-main-4442a4-7658d9667 Error creating: pods "payload-pre-processing-e2e-worker-single-main-4442a4-7658d9667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4442a4: serviceaccount "payload-processing-e2e-worker-single-main-4442a4" not found 12m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-single-main-4442a4-7658d9667 Created pod: payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn 12m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-fcb75c45f from 1 to 4 12m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 12m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-krhrv 12m Warning FailedCreate replicaset/payload-processing-e2e-worker-single-main-4442a4-7cff98b6b Error creating: pods "payload-processing-e2e-worker-single-main-4442a4-7cff98b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4442a4: serviceaccount "payload-processing-e2e-worker-single-main-4442a4" not found 12m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-4f6wl 12m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-single-main-4442a4 Scaled up replica set payload-processing-e2e-worker-single-main-4442a4-7cff98b6b from 0 to 1 12m Normal AddedInterface pod/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn Add eth0 [10.132.1.38/23] from ovn-kubernetes 12m Normal Created pod/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn Container created 12m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-4f6wl Add eth0 [10.134.0.173/23] from ovn-kubernetes 12m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-4f6wl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 12m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-4f6wl Container created 12m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Container started 12m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Container created 12m Normal Pulled pod/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 12m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 12m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-4f6wl Container started 12m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Add eth0 [10.132.1.36/23] from ovn-kubernetes 12m Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Container started 12m Normal Started pod/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d Container started 12m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Add eth0 [10.133.0.202/23] from ovn-kubernetes 12m Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 12m Normal Created pod/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d Container created 12m Normal Pulled pod/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 12m Normal Started pod/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn Container started 12m Normal AddedInterface pod/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d Add eth0 [10.132.1.39/23] from ovn-kubernetes 12m Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Container created 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-4f6wl Startup probe failed: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-4f6wl Startup probe error: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Startup probe failed: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Startup probe error: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused... 12m Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Startup probe failed: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused 12m Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Startup probe error: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused... 11m Warning Unhealthy pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Readiness probe failed: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused 11m Warning ProbeError pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Readiness probe error: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused... 11m Normal Started pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Container started 11m Normal Created pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Container created 11m Normal Pulled pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 11m Warning Unhealthy pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Startup probe failed: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused 11m Warning ProbeError pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Startup probe error: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused... 11m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-4442a4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-4442a4-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-4442a4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 11m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-4442a4-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 11m Normal Killing pod/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn Stopping container payload-pre-processing 11m Normal Killing pod/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d Stopping container payload-processing 10m Normal Killing pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Stopping container istio-proxy 10m Warning ProbeError pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Readiness probe error: HTTP probe failed with statuscode: 503... 10m Warning Unhealthy pod/e2e-worker-single-main-4442a4-openshift-default-b7d765c97-rcf2h Readiness probe failed: HTTP probe failed with statuscode: 503 10m Warning Unhealthy pod/payload-processing-e2e-worker-single-main-4442a4-7cff98b6bzhn8d Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 10m Warning Unhealthy pod/payload-pre-processing-e2e-worker-single-main-4442a4-7658db52vn Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 10m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-fcb75c45f from 4 to 8 10m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 10m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-wp8sz 10m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-fj62v 10m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-2z5gd 10m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-2cl2z 10m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Add eth0 [10.132.1.41/23] from ovn-kubernetes 10m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Add eth0 [10.133.0.204/23] from ovn-kubernetes 10m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Add eth0 [10.133.0.203/23] from ovn-kubernetes 10m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-wp8sz Add eth0 [10.134.0.177/23] from ovn-kubernetes 10m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 10; reason: 10m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-fcb75c45f from 8 to 10 10m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-lc2bv 10m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-fcb75c45f Created pod: maas-default-gateway-openshift-default-fcb75c45f-k6fhj 10m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Add eth0 [10.134.0.178/23] from ovn-kubernetes 10m Normal AddedInterface pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Add eth0 [10.132.1.42/23] from ovn-kubernetes 8m49s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Readiness probe error: Get "http://10.134.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 8m49s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Readiness probe failed: Get "http://10.134.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m46s Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Container created 8m46s Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-wp8sz Container created 8m46s Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m46s Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Container started 8m46s Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Container started 8m46s Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-wp8sz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m46s Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Container started 8m46s Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Container created 8m46s Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m46s Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m46s Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m46s Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Container created 8m46s Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-wp8sz Container started 8m46s Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Container created 8m46s Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Container started 8m46s Normal Created pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Container created 8m46s Normal Pulled pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m46s Normal Started pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Container started 8m40s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Startup probe error: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused... 8m40s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-k6fhj Startup probe failed: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused 8m40s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-wp8sz Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused 8m40s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-wp8sz Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused... 8m39s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Startup probe error: Get "http://10.132.1.41:15021/healthz/ready": dial tcp 10.132.1.41:15021: connect: connection refused... 8m39s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Startup probe error: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused... 8m39s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Startup probe failed: Get "http://10.132.1.41:15021/healthz/ready": dial tcp 10.132.1.41:15021: connect: connection refused 8m39s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused... 8m39s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Startup probe failed: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused 8m39s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused 8m39s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused 8m39s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused... 8m12s Normal SuccessfulCreate replicaset/e2e-worker-single-main-4b0085-openshift-default-5499b86fcc Created pod: e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f 8m12s Normal ScalingReplicaSet deployment/e2e-worker-single-main-4b0085-openshift-default Scaled up replica set e2e-worker-single-main-4b0085-openshift-default-5499b86fcc from 0 to 1 8m12s Normal AddedLabel gateway/e2e-worker-single-main-4b0085 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-4b0085 8m11s Normal AddedInterface pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Add eth0 [10.133.0.205/23] from ovn-kubernetes 8m7s Normal Pulled pod/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 8m7s Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-single-main-4b0085 Scaled up replica set payload-processing-e2e-worker-single-main-4b0085-76c67d8778 from 0 to 1 8m7s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-single-main-4b0085 Scaled up replica set payload-pre-processing-e2e-worker-single-main-4b0085-7f8d596967 from 0 to 1 8m7s Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d596967 Error creating: pods "payload-pre-processing-e2e-worker-single-main-4b0085-7f8d596967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4b0085: serviceaccount "payload-processing-e2e-worker-single-main-4b0085" not found 8m7s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d596967 Created pod: payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 8m7s Normal AddedInterface pod/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 Add eth0 [10.132.1.46/23] from ovn-kubernetes 8m7s Normal Started pod/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 Container started 8m7s Warning FailedCreate replicaset/payload-processing-e2e-worker-single-main-4b0085-76c67d8778 Error creating: pods "payload-processing-e2e-worker-single-main-4b0085-76c67d8778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4b0085: serviceaccount "payload-processing-e2e-worker-single-main-4b0085" not found 8m7s Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-single-main-4b0085-76c67d8778 Created pod: payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm 8m7s Normal Created pod/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 Container created 8m7s Normal AddedInterface pod/payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm Add eth0 [10.133.0.206/23] from ovn-kubernetes 8m7s Normal Pulled pod/payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 8m7s Normal Created pod/payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm Container created 8m7s Normal Started pod/payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm Container started 7m56s Normal Pulled pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 7m56s Normal Created pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Container created 7m56s Normal Started pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Container started 7m50s Warning Unhealthy pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Startup probe failed: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused 7m50s Warning ProbeError pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Startup probe error: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused... 7m42s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-4b0085-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 7m42s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-4b0085-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 7m12s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-4b0085-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m12s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-4b0085-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m1s Normal Killing pod/payload-pre-processing-e2e-worker-single-main-4b0085-7f8d5dtqd8 Stopping container payload-pre-processing 7m1s Normal Killing pod/payload-processing-e2e-worker-single-main-4b0085-76c67d877g58vm Stopping container payload-processing 6m53s Normal Killing pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Stopping container istio-proxy 6m49s Warning Unhealthy pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Readiness probe failed: HTTP probe failed with statuscode: 503 6m49s Warning ProbeError pod/e2e-worker-single-main-4b0085-openshift-default-5499b86fccm6r7f Readiness probe error: HTTP probe failed with statuscode: 503... 5m43s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Readiness probe failed: Get "http://10.132.1.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 5m43s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-8bcwd Readiness probe error: Get "http://10.132.1.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 5m43s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Readiness probe error: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 5m43s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-krhrv Readiness probe failed: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 5m18s Normal AddedLabel gateway/e2e-ait-364642e1 Added label istio.io/rev=openshift-gateway to gateway e2e-ait-364642e1 5m18s Normal SuccessfulCreate replicaset/e2e-ait-364642e1-openshift-default-f6946bcc9 Created pod: e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 5m18s Normal ScalingReplicaSet deployment/e2e-ait-364642e1-openshift-default Scaled up replica set e2e-ait-364642e1-openshift-default-f6946bcc9 from 0 to 1 5m17s Normal AddedInterface pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Add eth0 [10.132.1.53/23] from ovn-kubernetes 5m14s Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-364642e1 Scaled up replica set payload-processing-e2e-ait-364642e1-868b5cc9cb from 0 to 1 5m14s Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-364642e1-868b5cc9cb Created pod: payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm 5m14s Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc Error creating: pods "payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-364642e1: serviceaccount "payload-processing-e2e-ait-364642e1" not found 5m14s Warning FailedCreate replicaset/payload-processing-e2e-ait-364642e1-868b5cc9cb Error creating: pods "payload-processing-e2e-ait-364642e1-868b5cc9cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-364642e1: serviceaccount "payload-processing-e2e-ait-364642e1" not found 5m14s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc Created pod: payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp 5m14s Normal Pulled pod/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 5m14s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-364642e1 Scaled up replica set payload-pre-processing-e2e-ait-364642e1-6794bdd4dc from 0 to 1 5m14s Normal AddedInterface pod/payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm Add eth0 [10.133.0.211/23] from ovn-kubernetes 5m14s Normal AddedInterface pod/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp Add eth0 [10.133.0.210/23] from ovn-kubernetes 5m14s Normal Pulled pod/payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 5m13s Normal Created pod/payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm Container created 5m13s Normal Created pod/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp Container created 5m13s Normal Started pod/payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm Container started 5m13s Normal Started pod/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp Container started 5m2s Normal Started pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Container started 5m2s Normal Created pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Container created 5m2s Normal Pulled pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 4m57s Warning Unhealthy pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Startup probe failed: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused 4m57s Warning ProbeError pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Startup probe error: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused... 4m49s Normal Killing pod/payload-pre-processing-e2e-ait-364642e1-6794bdd4dc-gcpsp Stopping container payload-pre-processing 4m49s Normal Killing pod/payload-processing-e2e-ait-364642e1-868b5cc9cb-7vrmm Stopping container payload-processing 4m48s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-364642e1-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m48s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-364642e1-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 4m43s Normal Killing pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Stopping container istio-proxy 4m42s Normal AddedLabel gateway/e2e-authcfg-http-ca53c0 Added label istio.io/rev=openshift-gateway to gateway e2e-authcfg-http-ca53c0 4m41s Normal AddedInterface pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Add eth0 [10.133.0.212/23] from ovn-kubernetes 4m41s Normal ScalingReplicaSet deployment/e2e-authcfg-http-ca53c0-openshift-default Scaled up replica set e2e-authcfg-http-ca53c0-openshift-default-cb7547f57 from 0 to 1 4m41s Normal SuccessfulCreate replicaset/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57 Created pod: e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f 4m41s Warning Unhealthy pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Readiness probe failed: HTTP probe failed with statuscode: 503 4m41s Warning ProbeError pod/e2e-ait-364642e1-openshift-default-f6946bcc9-2k2w4 Readiness probe error: HTTP probe failed with statuscode: 503... 4m37s Warning FailedCreate replicaset/payload-processing-e2e-authcfg-http-ca53c0-7777855786 Error creating: pods "payload-processing-e2e-authcfg-http-ca53c0-7777855786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-authcfg-http-ca53c0: serviceaccount "payload-processing-e2e-authcfg-http-ca53c0" not found 4m37s Normal SuccessfulCreate replicaset/payload-processing-e2e-authcfg-http-ca53c0-7777855786 Created pod: payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq 4m37s Normal ScalingReplicaSet deployment/payload-processing-e2e-authcfg-http-ca53c0 Scaled up replica set payload-processing-e2e-authcfg-http-ca53c0-7777855786 from 0 to 1 4m37s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f Created pod: payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt 4m37s Warning FailedCreate replicaset/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f Error creating: pods "payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-authcfg-http-ca53c0: serviceaccount "payload-processing-e2e-authcfg-http-ca53c0" not found 4m37s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-authcfg-http-ca53c0 Scaled up replica set payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f from 0 to 1 4m36s Normal Created pod/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt Container created 4m36s Normal Started pod/payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq Container started 4m36s Normal AddedInterface pod/payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq Add eth0 [10.133.0.214/23] from ovn-kubernetes 4m36s Normal Started pod/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt Container started 4m36s Normal Pulled pod/payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 4m36s Normal Pulled pod/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 4m36s Normal AddedInterface pod/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt Add eth0 [10.133.0.213/23] from ovn-kubernetes 4m36s Normal Created pod/payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq Container created 4m26s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-authcfg-http-ca53c0-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 4m26s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-authcfg-http-ca53c0-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 4m24s Warning ProbeError pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Readiness probe error: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused... 4m24s Warning Unhealthy pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Readiness probe failed: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused 4m24s Normal Pulled pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 4m24s Normal Created pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Container created 4m24s Normal Started pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Container started 4m19s Warning ProbeError pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Startup probe error: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused... 4m19s Warning Unhealthy pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Startup probe failed: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused 3m56s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-authcfg-http-ca53c0-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 3m56s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-authcfg-http-ca53c0-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 2m53s Normal Killing pod/payload-processing-e2e-authcfg-http-ca53c0-7777855786-s9mkq Stopping container payload-processing 2m53s Normal Killing pod/payload-pre-processing-e2e-authcfg-http-ca53c0-866db7d97f-6qvzt Stopping container payload-pre-processing 2m41s Normal Killing pod/e2e-authcfg-http-ca53c0-openshift-default-cb7547f57-pdg5f Stopping container istio-proxy 2m37s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Readiness probe error: Get "http://10.133.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 2m37s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Readiness probe failed: Get "http://10.133.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2m37s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-fj62v Readiness probe error: Get "http://10.133.0.203:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 2m37s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-2cl2z Readiness probe failed: Get "http://10.133.0.204:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2m36s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Readiness probe error: Get "http://10.132.1.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 2m36s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-lc2bv Readiness probe failed: Get "http://10.132.1.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2m36s Warning Unhealthy pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Readiness probe failed: Get "http://10.132.1.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2m36s Warning ProbeError pod/maas-default-gateway-openshift-default-fcb75c45f-2z5gd Readiness probe error: Get "http://10.132.1.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)...