=== events in openshift-ingress (2026-10-30T22:36:52Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 52m Normal Scheduled pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Successfully assigned openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk to ip-10-0-135-205.us-west-1.compute.internal 49m Normal Scheduled pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Successfully assigned openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 to ip-10-0-142-119.us-west-1.compute.internal 68m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd to ip-10-0-135-205.us-west-1.compute.internal 60m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb to ip-10-0-128-26.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 to ip-10-0-128-26.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 to ip-10-0-128-26.us-west-1.compute.internal 54m Normal Scheduled pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Successfully assigned openshift-ingress/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 to ip-10-0-142-119.us-west-1.compute.internal 43m Normal Scheduled pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Successfully assigned openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp to ip-10-0-135-205.us-west-1.compute.internal 29m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-zqcqx to ip-10-0-142-119.us-west-1.compute.internal 40m Normal Scheduled pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Successfully assigned openshift-ingress/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh to ip-10-0-128-26.us-west-1.compute.internal 48m Normal Scheduled pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Successfully assigned openshift-ingress/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 to ip-10-0-128-26.us-west-1.compute.internal 69m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 to ip-10-0-135-205.us-west-1.compute.internal 69m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Successfully assigned openshift-ingress/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn to ip-10-0-142-119.us-west-1.compute.internal 70m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rnc59 to ip-10-0-142-119.us-west-1.compute.internal 76m Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq to ip-10-0-135-205.us-west-1.compute.internal 31m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx to ip-10-0-135-205.us-west-1.compute.internal 29m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 to ip-10-0-128-26.us-west-1.compute.internal 53m Normal Scheduled pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Successfully assigned openshift-ingress/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd to ip-10-0-128-26.us-west-1.compute.internal 70m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qjrxc to ip-10-0-142-119.us-west-1.compute.internal 54m Normal Scheduled pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Successfully assigned openshift-ingress/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 to ip-10-0-142-119.us-west-1.compute.internal 53m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 to ip-10-0-142-119.us-west-1.compute.internal 70m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj to ip-10-0-135-205.us-west-1.compute.internal 80m Normal Scheduled pod/router-default-6d7bfbd7bc-slk74 Successfully assigned openshift-ingress/router-default-6d7bfbd7bc-slk74 to ip-10-0-135-205.us-west-1.compute.internal 80m Warning FailedScheduling pod/router-default-6d7bfbd7bc-slk74 no nodes available to schedule pods 86m Warning FailedScheduling pod/router-default-6d7bfbd7bc-slk74 no nodes available to schedule pods 57m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz to ip-10-0-135-205.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 to ip-10-0-128-26.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 to ip-10-0-142-119.us-west-1.compute.internal 62m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f to ip-10-0-128-26.us-west-1.compute.internal 68m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh to ip-10-0-135-205.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 to ip-10-0-142-119.us-west-1.compute.internal 62m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 to ip-10-0-135-205.us-west-1.compute.internal 67m Normal Scheduled pod/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt Successfully assigned openshift-ingress/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk to ip-10-0-135-205.us-west-1.compute.internal 37m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s to ip-10-0-142-119.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Successfully assigned openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl to ip-10-0-142-119.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Successfully assigned openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr to ip-10-0-135-205.us-west-1.compute.internal 68m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq to ip-10-0-142-119.us-west-1.compute.internal 37m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn to ip-10-0-128-26.us-west-1.compute.internal 68m Normal Scheduled pod/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd to ip-10-0-142-119.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv to ip-10-0-142-119.us-west-1.compute.internal 61m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 to ip-10-0-128-26.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Successfully assigned openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-424pm to ip-10-0-128-26.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Successfully assigned openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 to ip-10-0-135-205.us-west-1.compute.internal 68m Normal Scheduled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Successfully assigned openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp to ip-10-0-142-119.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg to ip-10-0-128-26.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Successfully assigned openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp to ip-10-0-135-205.us-west-1.compute.internal 67m Normal Scheduled pod/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h to ip-10-0-142-119.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 to ip-10-0-135-205.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Successfully assigned openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Successfully assigned openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf to ip-10-0-128-26.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 to ip-10-0-128-26.us-west-1.compute.internal 59m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw to ip-10-0-128-26.us-west-1.compute.internal 18m Normal Scheduled pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Successfully assigned openshift-ingress/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb to ip-10-0-142-119.us-west-1.compute.internal 68m Normal Scheduled pod/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g to ip-10-0-128-26.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr to ip-10-0-135-205.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Successfully assigned openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc to ip-10-0-142-119.us-west-1.compute.internal 59m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb to ip-10-0-142-119.us-west-1.compute.internal 23m Normal Scheduled pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Successfully assigned openshift-ingress/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 to ip-10-0-142-119.us-west-1.compute.internal 62m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 to ip-10-0-135-205.us-west-1.compute.internal 68m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc to ip-10-0-128-26.us-west-1.compute.internal 48m Normal Scheduled pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Successfully assigned openshift-ingress/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm to ip-10-0-128-26.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f to ip-10-0-128-26.us-west-1.compute.internal 67m Normal Scheduled pod/payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc to ip-10-0-128-26.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Successfully assigned openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 to ip-10-0-142-119.us-west-1.compute.internal 47m Normal Scheduled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Successfully assigned openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Successfully assigned openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Successfully assigned openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l to ip-10-0-128-26.us-west-1.compute.internal 67m Normal Scheduled pod/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 to ip-10-0-128-26.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb to ip-10-0-135-205.us-west-1.compute.internal 47m Normal Scheduled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Successfully assigned openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z to ip-10-0-135-205.us-west-1.compute.internal 47m Normal Scheduled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Successfully assigned openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr to ip-10-0-142-119.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Successfully assigned openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz to ip-10-0-128-26.us-west-1.compute.internal 67m Normal Scheduled pod/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt to ip-10-0-128-26.us-west-1.compute.internal 12m Normal Scheduled pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Successfully assigned openshift-ingress/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr to ip-10-0-142-119.us-west-1.compute.internal 17m Normal Scheduled pod/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x to ip-10-0-128-26.us-west-1.compute.internal 23m Normal Scheduled pod/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl to ip-10-0-128-26.us-west-1.compute.internal 50m Normal Scheduled pod/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt to ip-10-0-128-26.us-west-1.compute.internal 52m Normal Scheduled pod/payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj to ip-10-0-128-26.us-west-1.compute.internal 50m Normal Scheduled pod/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 to ip-10-0-128-26.us-west-1.compute.internal 53m Normal Scheduled pod/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns to ip-10-0-128-26.us-west-1.compute.internal 54m Normal Scheduled pod/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx to ip-10-0-128-26.us-west-1.compute.internal 41m Normal Scheduled pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh Successfully assigned openshift-ingress/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh to ip-10-0-128-26.us-west-1.compute.internal 35m Normal Scheduled pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h Successfully assigned openshift-ingress/payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h to ip-10-0-142-119.us-west-1.compute.internal 52m Normal Scheduled pod/payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 Successfully assigned openshift-ingress/payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk to ip-10-0-142-119.us-west-1.compute.internal 40m Normal Scheduled pod/payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl to ip-10-0-142-119.us-west-1.compute.internal 42m Normal Scheduled pod/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj to ip-10-0-142-119.us-west-1.compute.internal 47m Normal Scheduled pod/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz to ip-10-0-142-119.us-west-1.compute.internal 45m Normal Scheduled pod/payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Successfully assigned openshift-ingress/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 Successfully assigned openshift-ingress/payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 to ip-10-0-142-119.us-west-1.compute.internal 10m Normal Scheduled pod/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm Successfully assigned openshift-ingress/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm to ip-10-0-142-119.us-west-1.compute.internal 46m Normal Scheduled pod/payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g to ip-10-0-142-119.us-west-1.compute.internal 47m Normal Scheduled pod/payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 to ip-10-0-142-119.us-west-1.compute.internal 50m Normal Scheduled pod/payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv Successfully assigned openshift-ingress/payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv to ip-10-0-128-26.us-west-1.compute.internal 49m Normal Scheduled pod/payload-processing-e2e-api-a-b34958-9786989c7-lcprk Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b34958-9786989c7-lcprk to ip-10-0-128-26.us-west-1.compute.internal 48m Normal Scheduled pod/payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc to ip-10-0-128-26.us-west-1.compute.internal 12m Normal Scheduled pod/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 Successfully assigned openshift-ingress/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 to ip-10-0-142-119.us-west-1.compute.internal 56m Normal Scheduled pod/payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf Successfully assigned openshift-ingress/payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf to ip-10-0-128-26.us-west-1.compute.internal 54m Normal Scheduled pod/payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 Successfully assigned openshift-ingress/payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 to ip-10-0-142-119.us-west-1.compute.internal 53m Normal Scheduled pod/payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz Successfully assigned openshift-ingress/payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz to ip-10-0-128-26.us-west-1.compute.internal 68m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm to ip-10-0-128-26.us-west-1.compute.internal 50m Normal Scheduled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Successfully assigned openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg to ip-10-0-135-205.us-west-1.compute.internal 49m Normal Scheduled pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Successfully assigned openshift-ingress/e2e-api-a-b34958-openshift-default-559d74f555-htq4p to ip-10-0-128-26.us-west-1.compute.internal 60m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj to ip-10-0-142-119.us-west-1.compute.internal 62m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw to ip-10-0-135-205.us-west-1.compute.internal 10m Normal Scheduled pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Successfully assigned openshift-ingress/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Successfully assigned openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Successfully assigned openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl to ip-10-0-128-26.us-west-1.compute.internal 69m Normal Scheduled pod/payload-processing-55fbbbf9dc-fgz7d Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-fgz7d to ip-10-0-142-119.us-west-1.compute.internal 58m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp to ip-10-0-128-26.us-west-1.compute.internal 49m Normal Scheduled pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Successfully assigned openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Successfully assigned openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh to ip-10-0-142-119.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs to ip-10-0-135-205.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks to ip-10-0-128-26.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c to ip-10-0-128-26.us-west-1.compute.internal 62m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd to ip-10-0-142-119.us-west-1.compute.internal 51m Normal Scheduled pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Successfully assigned openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd to ip-10-0-128-26.us-west-1.compute.internal 50m Normal Scheduled pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Successfully assigned openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc to ip-10-0-135-205.us-west-1.compute.internal 67m Normal Scheduled pod/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd to ip-10-0-128-26.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg to ip-10-0-142-119.us-west-1.compute.internal 68m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz to ip-10-0-135-205.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 to ip-10-0-135-205.us-west-1.compute.internal 57m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x to ip-10-0-142-119.us-west-1.compute.internal 55m Normal Scheduled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Successfully assigned openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f to ip-10-0-142-119.us-west-1.compute.internal 53m Normal Scheduled pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Successfully assigned openshift-ingress/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt to ip-10-0-128-26.us-west-1.compute.internal 68m Normal Scheduled pod/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 to ip-10-0-142-119.us-west-1.compute.internal 76m Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-jlgnp Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-jlgnp to ip-10-0-142-119.us-west-1.compute.internal 45m Normal Scheduled pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Successfully assigned openshift-ingress/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj to ip-10-0-142-119.us-west-1.compute.internal 53m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-pg8wh to ip-10-0-128-26.us-west-1.compute.internal 55m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 to ip-10-0-135-205.us-west-1.compute.internal 34m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx to ip-10-0-135-205.us-west-1.compute.internal 69m Normal Scheduled pod/payload-pre-processing-7b98bb678c-r9sf9 Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-r9sf9 to ip-10-0-128-26.us-west-1.compute.internal 69m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nfl6x to ip-10-0-128-26.us-west-1.compute.internal 54m Normal Scheduled pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Successfully assigned openshift-ingress/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx to ip-10-0-142-119.us-west-1.compute.internal 47m Normal Scheduled pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Successfully assigned openshift-ingress/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 to ip-10-0-128-26.us-west-1.compute.internal 67m Normal Scheduled pod/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 to ip-10-0-128-26.us-west-1.compute.internal 41m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c to ip-10-0-128-26.us-west-1.compute.internal 53m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp to ip-10-0-135-205.us-west-1.compute.internal 29m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-mblkw to ip-10-0-142-119.us-west-1.compute.internal 31m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 to ip-10-0-142-119.us-west-1.compute.internal 56m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln to ip-10-0-135-205.us-west-1.compute.internal 47m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-kk6pm to ip-10-0-128-26.us-west-1.compute.internal 73m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-v6qfg to ip-10-0-142-119.us-west-1.compute.internal 53m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 to ip-10-0-142-119.us-west-1.compute.internal 68m Normal Scheduled pod/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv to ip-10-0-128-26.us-west-1.compute.internal 74m Normal Scheduled pod/kube-auth-proxy-578b8bf98-4lglr Successfully assigned openshift-ingress/kube-auth-proxy-578b8bf98-4lglr to ip-10-0-142-119.us-west-1.compute.internal 74m Normal Scheduled pod/kube-auth-proxy-578b8bf98-fgttk Successfully assigned openshift-ingress/kube-auth-proxy-578b8bf98-fgttk to ip-10-0-128-26.us-west-1.compute.internal 34m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 to ip-10-0-142-119.us-west-1.compute.internal 35m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd to ip-10-0-142-119.us-west-1.compute.internal 69m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-2462j to ip-10-0-142-119.us-west-1.compute.internal 34m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g to ip-10-0-142-119.us-west-1.compute.internal 31m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-66hx9 to ip-10-0-142-119.us-west-1.compute.internal 46m Normal Scheduled pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Successfully assigned openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt to ip-10-0-135-205.us-west-1.compute.internal 67m Normal Scheduled pod/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq to ip-10-0-128-26.us-west-1.compute.internal 55m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 to ip-10-0-142-119.us-west-1.compute.internal 70m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-bz6dh to ip-10-0-128-26.us-west-1.compute.internal 34m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 to ip-10-0-135-205.us-west-1.compute.internal 34m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt to ip-10-0-128-26.us-west-1.compute.internal 29m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x to ip-10-0-135-205.us-west-1.compute.internal 29m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k to ip-10-0-135-205.us-west-1.compute.internal 29m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-f7ssq to ip-10-0-128-26.us-west-1.compute.internal 67m Normal Scheduled pod/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d to ip-10-0-128-26.us-west-1.compute.internal 76m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc to ip-10-0-135-205.us-west-1.compute.internal 35m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z to ip-10-0-142-119.us-west-1.compute.internal 35m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c to ip-10-0-135-205.us-west-1.compute.internal 70m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-flf64 to ip-10-0-128-26.us-west-1.compute.internal 34m Normal Scheduled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Successfully assigned openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h to ip-10-0-128-26.us-west-1.compute.internal 74m Normal Scheduled pod/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z to ip-10-0-135-205.us-west-1.compute.internal 52m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fzjdh to ip-10-0-142-119.us-west-1.compute.internal 53m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94 to ip-10-0-135-205.us-west-1.compute.internal 67m Normal Scheduled pod/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb to ip-10-0-142-119.us-west-1.compute.internal 17m Normal Scheduled pod/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z to ip-10-0-142-119.us-west-1.compute.internal 23m Normal Scheduled pod/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 to ip-10-0-128-26.us-west-1.compute.internal 50m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q to ip-10-0-142-119.us-west-1.compute.internal 52m Normal Scheduled pod/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr to ip-10-0-128-26.us-west-1.compute.internal 50m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg to ip-10-0-128-26.us-west-1.compute.internal 53m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 to ip-10-0-128-26.us-west-1.compute.internal 54m Normal Scheduled pod/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 to ip-10-0-128-26.us-west-1.compute.internal 41m Normal Scheduled pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl to ip-10-0-128-26.us-west-1.compute.internal 35m Normal Scheduled pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh to ip-10-0-142-119.us-west-1.compute.internal 52m Normal Scheduled pod/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Successfully assigned openshift-ingress/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n to ip-10-0-128-26.us-west-1.compute.internal 56m Normal Scheduled pod/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n to ip-10-0-142-119.us-west-1.compute.internal 40m Normal Scheduled pod/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 to ip-10-0-128-26.us-west-1.compute.internal 42m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 to ip-10-0-142-119.us-west-1.compute.internal 47m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx to ip-10-0-142-119.us-west-1.compute.internal 45m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq to ip-10-0-142-119.us-west-1.compute.internal 56m Normal Scheduled pod/payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm to ip-10-0-128-26.us-west-1.compute.internal 10m Normal Scheduled pod/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l Successfully assigned openshift-ingress/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l to ip-10-0-142-119.us-west-1.compute.internal 46m Normal Scheduled pod/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 to ip-10-0-142-119.us-west-1.compute.internal 47m Normal Scheduled pod/payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq to ip-10-0-142-119.us-west-1.compute.internal 50m Normal Scheduled pod/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc to ip-10-0-128-26.us-west-1.compute.internal 49m Normal Scheduled pod/payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp to ip-10-0-128-26.us-west-1.compute.internal 48m Normal Scheduled pod/payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg to ip-10-0-128-26.us-west-1.compute.internal 12m Normal Scheduled pod/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 to ip-10-0-142-119.us-west-1.compute.internal 48m Normal Scheduled pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Successfully assigned openshift-ingress/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 to ip-10-0-142-119.us-west-1.compute.internal 56m Normal Scheduled pod/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t to ip-10-0-128-26.us-west-1.compute.internal 54m Normal Scheduled pod/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs to ip-10-0-142-119.us-west-1.compute.internal 53m Normal Scheduled pod/payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv to ip-10-0-128-26.us-west-1.compute.internal 55m Normal Scheduled pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hqlmj to ip-10-0-128-26.us-west-1.compute.internal 87m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-6d7bfbd7bc from 0 to 1 87m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 87m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 87m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 86m Normal SuccessfulCreate replicaset/router-default-6d7bfbd7bc Created pod: router-default-6d7bfbd7bc-slk74 80m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 80m Warning FailedMount pod/router-default-6d7bfbd7bc-slk74 MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 80m Warning FailedMount pod/router-default-6d7bfbd7bc-slk74 MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 80m Warning FailedMount pod/router-default-6d7bfbd7bc-slk74 MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 80m Warning FailedMount pod/router-default-6d7bfbd7bc-slk74 MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 79m Warning Unhealthy pod/router-default-6d7bfbd7bc-slk74 Startup probe failed: HTTP probe failed with statuscode: 500 79m Warning ProbeError pod/router-default-6d7bfbd7bc-slk74 Startup probe error: HTTP probe failed with statuscode: 500... 79m Normal AddedInterface pod/router-default-6d7bfbd7bc-slk74 Add eth0 [10.132.0.18/23] from ovn-kubernetes 79m Normal Started pod/router-default-6d7bfbd7bc-slk74 Container started 79m Normal Pulled pod/router-default-6d7bfbd7bc-slk74 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 79m Normal Created pod/router-default-6d7bfbd7bc-slk74 Container created 76m Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 76m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 76m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-jlgnp 76m Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-jlgnp Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 76m Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-jlgnp Add eth0 [10.134.0.21/23] from ovn-kubernetes 76m Normal Started pod/istiod-openshift-gateway-7876bfcb74-jlgnp Container started 76m Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-jlgnp Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.678s (3.678s including waiting). Image size: 185476477 bytes. 76m Normal Created pod/istiod-openshift-gateway-7876bfcb74-jlgnp Container created 76m Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-7cc4b68895 from 0 to 1 76m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 0 to 1 76m Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-jlgnp Readiness probe error: HTTP probe failed with statuscode: 503... 76m Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-jlgnp Readiness probe failed: HTTP probe failed with statuscode: 503 76m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-fcgrc 76m Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-7cc4b68895 Created pod: openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq 76m Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 76m Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq Add eth0 [10.132.0.35/23] from ovn-kubernetes 76m Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 76m Normal Pulling pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 76m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Add eth0 [10.132.0.34/23] from ovn-kubernetes 76m Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 75m Normal Created pod/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq Container created 75m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.784s (9.784s including waiting). Image size: 183555333 bytes. 75m Normal Started pod/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq Container started 75m Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.594s (9.594s including waiting). Image size: 183555333 bytes. 75m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 75m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 75m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 75m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 74m Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-578b8bf98 from 0 to 2 74m Normal SuccessfulCreate replicaset/kube-auth-proxy-578b8bf98 Created pod: kube-auth-proxy-578b8bf98-fgttk 74m Normal SuccessfulCreate replicaset/kube-auth-proxy-578b8bf98 Created pod: kube-auth-proxy-578b8bf98-4lglr 74m Normal Pulling pod/kube-auth-proxy-578b8bf98-4lglr Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 74m Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z Add eth0 [10.132.0.43/23] from ovn-kubernetes 74m Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-6fd5fcc55c from 0 to 1 74m Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-6fd5fcc55c Created pod: data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z 74m Normal Pulling pod/kube-auth-proxy-578b8bf98-fgttk Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 74m Normal Pulled pod/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 74m Normal AddedInterface pod/kube-auth-proxy-578b8bf98-fgttk Add eth0 [10.133.0.22/23] from ovn-kubernetes 74m Normal AddedInterface pod/kube-auth-proxy-578b8bf98-4lglr Add eth0 [10.134.0.23/23] from ovn-kubernetes 74m Normal Started pod/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z Container started 74m Normal Created pod/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z Container created 74m Normal Started pod/kube-auth-proxy-578b8bf98-fgttk Container started 74m Normal Started pod/kube-auth-proxy-578b8bf98-4lglr Container started 74m Normal Created pod/kube-auth-proxy-578b8bf98-4lglr Container created 74m Normal Pulled pod/kube-auth-proxy-578b8bf98-4lglr Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.905s (2.905s including waiting). Image size: 188904677 bytes. 74m Normal Pulled pod/kube-auth-proxy-578b8bf98-fgttk Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.93s (2.93s including waiting). Image size: 188904677 bytes. 74m Normal Created pod/kube-auth-proxy-578b8bf98-fgttk Container created 74m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 74m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 73m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 73m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 73m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 73m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 73m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-v6qfg 73m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 73m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Container started 73m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Container created 73m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Add eth0 [10.134.0.28/23] from ovn-kubernetes 73m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod 73m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Readiness probe failed: HTTP probe failed with statuscode: 503 73m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Readiness probe error: HTTP probe failed with statuscode: 503... 73m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 73m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-jlgnp 73m Normal Killing pod/istiod-openshift-gateway-7876bfcb74-jlgnp Stopping container discovery 72m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Container created 72m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 72m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Container started 72m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 72m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 72m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused 72m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused... 71m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 71m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 70m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-flf64 70m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Add eth0 [10.133.0.28/23] from ovn-kubernetes 70m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-qjrxc 70m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Add eth0 [10.133.0.29/23] from ovn-kubernetes 70m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-bz6dh 70m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Add eth0 [10.134.0.36/23] from ovn-kubernetes 70m Normal Pulling pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 70m Normal Pulling pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 70m Normal Pulling pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 70m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Container started 70m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Container created 70m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.695s (3.695s including waiting). Image size: 183555333 bytes. 70m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Container created 70m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Container started 70m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Container created 70m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.149s (4.149s including waiting). Image size: 183555333 bytes. 70m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.97s (3.97s including waiting). Image size: 183555333 bytes. 70m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Container started 70m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused... 70m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused 70m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused 70m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused... 70m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused 70m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused... 70m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 70m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 70m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 70m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 70m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 4 to 6 70m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-qg4kj 70m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 70m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-rnc59 70m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Container started 70m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Add eth0 [10.132.0.54/23] from ovn-kubernetes 70m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Container created 70m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 70m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Add eth0 [10.134.0.38/23] from ovn-kubernetes 70m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Container started 70m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Container created 70m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused... 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused... 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 69m Normal ScalingReplicaSet deployment/payload-pre-processing Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 69m Normal SuccessfulCreate replicaset/payload-processing-55fbbbf9dc Created pod: payload-processing-55fbbbf9dc-fgz7d 69m Normal ScalingReplicaSet deployment/payload-processing Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1 69m Warning FailedCreate replicaset/payload-pre-processing-7b98bb678c Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 69m Warning FailedCreate replicaset/payload-processing-55fbbbf9dc Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 69m Normal SuccessfulCreate replicaset/payload-pre-processing-7b98bb678c Created pod: payload-pre-processing-7b98bb678c-r9sf9 69m Normal Pulling pod/payload-pre-processing-7b98bb678c-r9sf9 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 69m Normal Pulling pod/payload-processing-55fbbbf9dc-fgz7d Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 69m Normal AddedInterface pod/payload-processing-55fbbbf9dc-fgz7d Add eth0 [10.134.0.39/23] from ovn-kubernetes 69m Normal AddedInterface pod/payload-pre-processing-7b98bb678c-r9sf9 Add eth0 [10.133.0.33/23] from ovn-kubernetes 69m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc (combined from similar events): Created pod: maas-default-gateway-openshift-default-7f694df8bc-tzxd4 69m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-2462j 69m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-nfl6x 69m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-v8hp6 69m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 6 to 10 69m Normal Pulled pod/payload-pre-processing-7b98bb678c-r9sf9 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.608s (2.608s including waiting). Image size: 125353965 bytes. 69m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Container started 69m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 69m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 69m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Container created 69m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Container started 69m Normal Started pod/payload-pre-processing-7b98bb678c-r9sf9 Container started 69m Normal Created pod/payload-pre-processing-7b98bb678c-r9sf9 Container created 69m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Add eth0 [10.133.0.34/23] from ovn-kubernetes 69m Normal Created pod/payload-processing-55fbbbf9dc-fgz7d Container created 69m Normal Started pod/payload-processing-55fbbbf9dc-fgz7d Container started 69m Normal Pulled pod/payload-processing-55fbbbf9dc-fgz7d Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.523s (2.523s including waiting). Image size: 125353965 bytes. 69m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Add eth0 [10.133.0.35/23] from ovn-kubernetes 69m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 69m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Container created 69m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Container created 69m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Container started 69m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 69m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Add eth0 [10.132.0.56/23] from ovn-kubernetes 69m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Add eth0 [10.134.0.40/23] from ovn-kubernetes 69m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Container started 69m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Container created 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused... 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused... 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused... 69m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused 69m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused... 68m Normal AddedLabel gateway/e2e-worker-w5-021907 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-021907 68m Normal AddedLabel gateway/e2e-worker-w1-e4dadd Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-e4dadd 68m Normal AddedLabel gateway/e2e-worker-w4-07fa8e Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-07fa8e 68m Normal AddedLabel gateway/e2e-worker-w2-446ca2 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-446ca2 68m Normal AddedLabel gateway/e2e-worker-w3-9796f1 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-9796f1 68m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm 68m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled up replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 0 to 1 68m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled up replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 0 to 1 68m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr 68m Normal ScalingReplicaSet deployment/e2e-worker-w3-9796f1-openshift-default Scaled up replica set e2e-worker-w3-9796f1-openshift-default-5547cf6495 from 0 to 1 68m Normal SuccessfulCreate replicaset/e2e-worker-w3-9796f1-openshift-default-5547cf6495 Created pod: e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp 68m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 68m Normal AddedInterface pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Add eth0 [10.134.0.41/23] from ovn-kubernetes 68m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Add eth0 [10.133.0.36/23] from ovn-kubernetes 68m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled up replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 0 to 1 68m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Add eth0 [10.133.0.38/23] from ovn-kubernetes 68m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc 68m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Add eth0 [10.133.0.37/23] from ovn-kubernetes 68m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Add eth0 [10.134.0.42/23] from ovn-kubernetes 68m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled up replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 0 to 1 68m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w5-021907 Scaled up replica set payload-processing-e2e-worker-w5-021907-6fdc9848f9 from 0 to 1 68m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w5-021907 Scaled up replica set payload-pre-processing-e2e-worker-w5-021907-5f85877d59 from 0 to 1 68m Warning FailedCreate replicaset/payload-processing-e2e-worker-w5-021907-6fdc9848f9 Error creating: pods "payload-processing-e2e-worker-w5-021907-6fdc9848f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-021907: serviceaccount "payload-processing-e2e-worker-w5-021907" not found 68m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w5-021907-6fdc9848f9 Created pod: payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd 68m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq 68m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w5-021907-5f85877d59 Error creating: pods "payload-pre-processing-e2e-worker-w5-021907-5f85877d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-021907: serviceaccount "payload-processing-e2e-worker-w5-021907" not found 68m Normal Pulled pod/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 68m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 Add eth0 [10.134.0.43/23] from ovn-kubernetes 68m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w5-021907-5f85877d59 Created pod: payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 68m Normal AddedLabel gateway/e2e-worker-w6-89c0fd Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w6-89c0fd 68m Normal AddedLabel gateway/e2e-worker-w0-1b5b5f Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-1b5b5f 68m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled up replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 0 to 1 68m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz 68m Normal Started pod/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd Container started 68m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Add eth0 [10.132.0.57/23] from ovn-kubernetes 68m Normal AddedInterface pod/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd Add eth0 [10.134.0.44/23] from ovn-kubernetes 68m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Add eth0 [10.134.0.45/23] from ovn-kubernetes 68m Normal Started pod/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 Container started 68m Normal Created pod/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd Container created 68m Normal Pulled pod/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 68m Normal Created pod/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 Container created 68m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled up replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 0 to 1 68m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f Error creating: pods "payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9796f1: serviceaccount "payload-processing-e2e-worker-w3-9796f1" not found 68m Warning FailedCreate replicaset/payload-processing-e2e-worker-w3-9796f1-6799974f65 Error creating: pods "payload-processing-e2e-worker-w3-9796f1-6799974f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9796f1: serviceaccount "payload-processing-e2e-worker-w3-9796f1" not found 68m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w3-9796f1 Scaled up replica set payload-processing-e2e-worker-w3-9796f1-6799974f65 from 0 to 1 68m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w3-9796f1 Scaled up replica set payload-pre-processing-e2e-worker-w3-9796f1-fc64697f from 0 to 1 68m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w3-9796f1-6799974f65 Created pod: payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g 68m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv Add eth0 [10.133.0.39/23] from ovn-kubernetes 68m Normal AddedInterface pod/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g Add eth0 [10.133.0.40/23] from ovn-kubernetes 68m Normal Started pod/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv Container started 68m Normal Created pod/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv Container created 68m Normal Pulled pod/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 68m Normal Pulled pod/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 68m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f Created pod: payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv 67m Normal Created pod/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g Container created 67m Normal Started pod/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g Container started 67m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55 Created pod: payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d 67m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w1-e4dadd Scaled up replica set payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55 from 0 to 1 67m Warning FailedCreate replicaset/payload-processing-e2e-worker-w1-e4dadd-549899bd9c Error creating: pods "payload-processing-e2e-worker-w1-e4dadd-549899bd9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e4dadd: serviceaccount "payload-processing-e2e-worker-w1-e4dadd" not found 67m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w1-e4dadd Scaled up replica set payload-processing-e2e-worker-w1-e4dadd-549899bd9c from 0 to 1 67m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55 Error creating: pods "payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e4dadd: serviceaccount "payload-processing-e2e-worker-w1-e4dadd" not found 67m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w1-e4dadd-549899bd9c Created pod: payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs 67m Normal Created pod/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d Container created 67m Normal Started pod/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs Container started 67m Normal Pulled pod/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d Add eth0 [10.133.0.41/23] from ovn-kubernetes 67m Normal Created pod/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs Container created 67m Normal Started pod/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d Container started 67m Normal Pulled pod/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal AddedInterface pod/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs Add eth0 [10.133.0.42/23] from ovn-kubernetes 67m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555 Error creating: pods "payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-07fa8e: serviceaccount "payload-processing-e2e-worker-w4-07fa8e" not found 67m Warning FailedCreate replicaset/payload-processing-e2e-worker-w4-07fa8e-c95f9979c Error creating: pods "payload-processing-e2e-worker-w4-07fa8e-c95f9979c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-07fa8e: serviceaccount "payload-processing-e2e-worker-w4-07fa8e" not found 67m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w4-07fa8e Scaled up replica set payload-processing-e2e-worker-w4-07fa8e-c95f9979c from 0 to 1 67m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w4-07fa8e Scaled up replica set payload-pre-processing-e2e-worker-w4-07fa8e-769597d555 from 0 to 1 67m Normal Pulled pod/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal Pulled pod/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w4-07fa8e-c95f9979c Created pod: payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 67m Normal Created pod/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 Container created 67m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 Add eth0 [10.133.0.43/23] from ovn-kubernetes 67m Normal Started pod/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 Container started 67m Normal Started pod/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 Container started 67m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555 Created pod: payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 67m Normal AddedInterface pod/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 Add eth0 [10.133.0.44/23] from ovn-kubernetes 67m Normal Created pod/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 Container created 67m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5 Error creating: pods "payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-446ca2: serviceaccount "payload-processing-e2e-worker-w2-446ca2" not found 67m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w2-446ca2-5db4694b8c Created pod: payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc 67m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w2-446ca2 Scaled up replica set payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5 from 0 to 1 67m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w2-446ca2 Scaled up replica set payload-processing-e2e-worker-w2-446ca2-5db4694b8c from 0 to 1 67m Warning FailedCreate replicaset/payload-processing-e2e-worker-w2-446ca2-5db4694b8c Error creating: pods "payload-processing-e2e-worker-w2-446ca2-5db4694b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-446ca2: serviceaccount "payload-processing-e2e-worker-w2-446ca2" not found 67m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5 Created pod: payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq 67m Normal Started pod/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq Container started 67m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq Add eth0 [10.133.0.45/23] from ovn-kubernetes 67m Normal Pulled pod/payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal Created pod/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq Container created 67m Normal Created pod/payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc Container created 67m Normal Pulled pod/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal Started pod/payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc Container started 67m Normal AddedInterface pod/payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc Add eth0 [10.133.0.46/23] from ovn-kubernetes 67m Normal Started pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Container started 67m Normal Pulled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 67m Normal Created pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Container created 67m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 67m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w6-89c0fd Scaled up replica set payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f from 0 to 1 67m Warning FailedCreate replicaset/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47 Error creating: pods "payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-89c0fd: serviceaccount "payload-processing-e2e-worker-w6-89c0fd" not found 67m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 67m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f Error creating: pods "payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-89c0fd: serviceaccount "payload-processing-e2e-worker-w6-89c0fd" not found 67m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w6-89c0fd Scaled up replica set payload-processing-e2e-worker-w6-89c0fd-78cdfddb47 from 0 to 1 67m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f Created pod: payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd 67m Normal Created pod/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd Container created 67m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47 Created pod: payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt 67m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused 67m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd Add eth0 [10.133.0.47/23] from ovn-kubernetes 67m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused... 67m Normal Pulled pod/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal Started pod/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd Container started 67m Normal Created pod/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt Container created 67m Normal AddedInterface pod/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt Add eth0 [10.133.0.48/23] from ovn-kubernetes 67m Normal Pulled pod/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal Started pod/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt Container started 67m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": read tcp 10.134.0.2:35804->10.134.0.42:15021: read: connection reset by peer 67m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": read tcp 10.134.0.2:35804->10.134.0.42:15021: read: connection reset by peer... 67m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 67m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Container started 67m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Container created 67m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w0-1b5b5f Scaled up replica set payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc from 0 to 1 67m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w0-1b5b5f Scaled up replica set payload-processing-e2e-worker-w0-1b5b5f-6766bd67c from 0 to 1 67m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c Created pod: payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt 67m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc Created pod: payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb 67m Warning FailedCreate replicaset/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c Error creating: pods "payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1b5b5f: serviceaccount "payload-processing-e2e-worker-w0-1b5b5f" not found 67m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc Error creating: pods "payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1b5b5f: serviceaccount "payload-processing-e2e-worker-w0-1b5b5f" not found 67m Normal Started pod/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb Container started 67m Normal Pulled pod/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal Started pod/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt Container started 67m Normal Created pod/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb Container created 67m Normal Pulled pod/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 67m Normal AddedInterface pod/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt Add eth0 [10.133.0.49/23] from ovn-kubernetes 67m Normal Created pod/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt Container created 67m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb Add eth0 [10.134.0.49/23] from ovn-kubernetes 67m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused... 67m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused 67m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 67m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 67m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Container created 67m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Container started 67m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Container created 67m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Container started 67m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused 67m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused... 67m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused 67m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused... 67m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w3-9796f1-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 67m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w3-9796f1-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 67m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 67m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 67m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Container created 67m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Container started 67m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 67m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused... 67m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused 67m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 67m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 66m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 66m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Container created 66m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 66m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Container started 66m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 66m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 66m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 66m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 66m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused 66m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused... 66m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 66m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": read tcp 10.133.0.2:48522->10.133.0.36:15021: read: connection reset by peer... 66m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": read tcp 10.133.0.2:48522->10.133.0.36:15021: read: connection reset by peer 66m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Container started 66m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Container created 66m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused... 66m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused 66m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 66m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 64m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-flf64 64m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 8; reason: All metrics below target 64m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-bz6dh Stopping container istio-proxy 64m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-bz6dh 64m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 10 to 8 64m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-flf64 Stopping container istio-proxy 62m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 62m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Add eth0 [10.132.0.68/23] from ovn-kubernetes 62m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 62m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled up replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 1 to 2 62m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 62m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled up replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 1 to 2 62m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 62m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 62m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Add eth0 [10.132.0.69/23] from ovn-kubernetes 62m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 62m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Container started 62m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Container created 62m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Container created 62m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Container started 62m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused... 62m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused 62m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused... 62m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused 62m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled up replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 1 to 2 62m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj Stopping container istio-proxy 62m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 6; reason: All metrics below target 62m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 62m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 8 to 6 62m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw 62m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-rnc59 Stopping container istio-proxy 62m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Add eth0 [10.132.0.70/23] from ovn-kubernetes 62m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-rnc59 62m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-qg4kj 62m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 62m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Container created 62m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Container started 62m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused 62m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused... 62m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 62m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled up replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 1 to 2 62m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd 62m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Container created 62m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Container started 62m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 62m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Add eth0 [10.134.0.56/23] from ovn-kubernetes 62m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 6 to 5 62m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 Stopping container istio-proxy 62m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-v8hp6 62m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 62m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled up replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 1 to 2 62m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f 62m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Add eth0 [10.133.0.84/23] from ovn-kubernetes 62m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused 62m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused... 62m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 62m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Container created 62m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Container started 62m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused 62m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused... 61m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 4; reason: All metrics below target 61m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 5 to 4 61m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-tzxd4 Stopping container istio-proxy 61m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-tzxd4 61m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x 61m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled up replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 1 to 2 61m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 61m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Container created 61m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Container started 61m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 61m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Add eth0 [10.132.0.72/23] from ovn-kubernetes 61m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused 61m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused... 60m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 4 to 3 60m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-2462j Stopping container istio-proxy 60m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-2462j 60m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 60m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled up replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 2 to 3 60m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 60m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 60m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Container started 60m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Add eth0 [10.132.0.73/23] from ovn-kubernetes 60m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Container created 60m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused 60m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused... 60m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 60m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj 60m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled up replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 2 to 3 60m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 60m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Container started 60m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Container created 60m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Add eth0 [10.134.0.59/23] from ovn-kubernetes 60m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused... 60m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused 59m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-fcgrc 59m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc Stopping container istio-proxy 59m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled up replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 2 to 4 59m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Container created 59m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb 59m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 59m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Add eth0 [10.133.0.92/23] from ovn-kubernetes 59m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw 59m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Container started 59m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 59m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 59m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Add eth0 [10.134.0.61/23] from ovn-kubernetes 59m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Container created 59m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Container started 59m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused... 59m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused 59m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused... 59m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused 58m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Container created 58m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 58m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 58m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Container started 58m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Add eth0 [10.134.0.63/23] from ovn-kubernetes 58m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled up replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 2 to 3 58m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused... 58m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused 58m Normal ScalingReplicaSet deployment/e2e-worker-w3-9796f1-openshift-default Scaled up replica set e2e-worker-w3-9796f1-openshift-default-5547cf6495 from 1 to 2 58m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 58m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 58m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled up replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 3 to 4 58m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-9796f1-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 58m Normal SuccessfulCreate replicaset/e2e-worker-w3-9796f1-openshift-default-5547cf6495 Created pod: e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp 58m Normal Started pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Container started 58m Normal AddedInterface pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Add eth0 [10.132.0.77/23] from ovn-kubernetes 58m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Add eth0 [10.133.0.96/23] from ovn-kubernetes 58m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Container started 58m Normal Created pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Container created 58m Normal Pulled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Container created 58m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused... 58m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused 58m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused... 58m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused 58m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr 58m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x 58m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f 58m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled up replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 4 to 7 58m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 7; reason: cpu resource utilization (percentage of request) above target 58m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Container created 58m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Container started 58m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Container started 58m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Add eth0 [10.133.0.98/23] from ovn-kubernetes 58m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Add eth0 [10.132.0.78/23] from ovn-kubernetes 58m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Add eth0 [10.134.0.64/23] from ovn-kubernetes 58m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Container created 58m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Container started 58m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Container created 58m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused 58m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused 58m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused... 58m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused... 58m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused 58m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused... 58m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Add eth0 [10.132.0.79/23] from ovn-kubernetes 58m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg 58m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 58m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Add eth0 [10.133.0.102/23] from ovn-kubernetes 58m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Container started 58m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Container created 58m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Container started 58m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Container created 58m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb 58m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Add eth0 [10.132.0.80/23] from ovn-kubernetes 58m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 58m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Add eth0 [10.134.0.65/23] from ovn-kubernetes 58m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Add eth0 [10.133.0.104/23] from ovn-kubernetes 58m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp 58m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq 58m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled up replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 3 to 6 58m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Container started 58m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Container created 58m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Container created 58m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Container created 58m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Container started 58m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Container started 58m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 58m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused 58m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused... 58m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused 58m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused... 58m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused... 58m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused... 58m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused 58m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused 58m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused 58m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused... 58m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled up replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 4 to 5 58m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv 57m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Container started 57m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Add eth0 [10.134.0.66/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Container created 57m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Add eth0 [10.134.0.67/23] from ovn-kubernetes 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 57m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Add eth0 [10.133.0.110/23] from ovn-kubernetes 57m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz 57m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l 57m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd 57m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb 57m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled up replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 4 to 8 57m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Add eth0 [10.132.0.83/23] from ovn-kubernetes 57m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Add eth0 [10.132.0.82/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused... 57m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Container started 57m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Container started 57m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Container created 57m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Container created 57m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Container started 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused 57m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Container started 57m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Container created 57m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Container created 57m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Readiness probe failed: Get "http://10.133.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Readiness probe error: Get "http://10.133.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 57m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz 57m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk 57m Normal SuccessfulCreate replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c (combined from similar events): Created pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 57m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled up replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 3 to 4 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 10; reason: All metrics below target 57m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled up replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 8 to 10 57m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Add eth0 [10.134.0.68/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Container created 57m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Container started 57m Normal AddedInterface pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Add eth0 [10.133.0.112/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Container started 57m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Container created 57m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Container created 57m Normal Started pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Container started 57m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Add eth0 [10.132.0.84/23] from ovn-kubernetes 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused 57m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled up replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 5 to 8 57m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 57m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 57m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 57m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Container created 57m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Container started 57m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Container created 57m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Add eth0 [10.133.0.116/23] from ovn-kubernetes 57m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Add eth0 [10.133.0.117/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Container created 57m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Container started 57m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Container started 57m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Add eth0 [10.132.0.85/23] from ovn-kubernetes 57m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh 57m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 57m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled up replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 6 to 8 57m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Add eth0 [10.134.0.69/23] from ovn-kubernetes 57m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Container started 57m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Container created 57m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Container created 57m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Container started 57m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Add eth0 [10.132.0.86/23] from ovn-kubernetes 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-9796f1-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 57m Normal SuccessfulCreate replicaset/e2e-worker-w3-9796f1-openshift-default-5547cf6495 Created pod: e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 57m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 57m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 57m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled up replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 4 to 6 57m Normal ScalingReplicaSet deployment/e2e-worker-w3-9796f1-openshift-default Scaled up replica set e2e-worker-w3-9796f1-openshift-default-5547cf6495 from 2 to 3 57m Normal AddedInterface pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Add eth0 [10.133.0.119/23] from ovn-kubernetes 57m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Container created 57m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Add eth0 [10.134.0.71/23] from ovn-kubernetes 57m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Container started 57m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Add eth0 [10.132.0.87/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal AddedInterface pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Add eth0 [10.134.0.72/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Container created 57m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr 57m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc 57m Normal SuccessfulCreate replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 (combined from similar events): Created pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 57m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled up replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 7 to 10 57m Normal Pulled pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Add eth0 [10.133.0.120/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal Created pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Container created 57m Normal Started pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Container started 57m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Container started 57m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Container created 57m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Add eth0 [10.134.0.70/23] from ovn-kubernetes 57m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Container started 57m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Container created 57m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused... 57m Normal Created pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Container created 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused... 57m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Container started 57m Normal Started pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Container started 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused... 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused 57m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz 57m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled up replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 2 to 4 57m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs 57m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Add eth0 [10.133.0.126/23] from ovn-kubernetes 57m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Add eth0 [10.132.0.89/23] from ovn-kubernetes 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 57m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Container created 57m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Container created 57m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Container started 57m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Container started 57m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-qjrxc 57m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-qjrxc Stopping container istio-proxy 57m Normal ScalingReplicaSet deployment/e2e-worker-w3-9796f1-openshift-default Scaled up replica set e2e-worker-w3-9796f1-openshift-default-5547cf6495 from 3 to 4 57m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-9796f1-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 57m Normal SuccessfulCreate replicaset/e2e-worker-w3-9796f1-openshift-default-5547cf6495 Created pod: e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 57m Normal AddedInterface pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Add eth0 [10.132.0.90/23] from ovn-kubernetes 57m Normal Started pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Container started 57m Normal Created pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Container created 57m Normal Pulled pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Readiness probe failed: Get "http://10.133.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Readiness probe error: Get "http://10.133.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Readiness probe failed: Get "http://10.133.0.117:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Readiness probe error: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Readiness probe failed: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Readiness probe error: Get "http://10.133.0.117:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Readiness probe error: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Readiness probe failed: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused... 57m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused 57m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 57m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 57m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused... 56m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Add eth0 [10.134.0.73/23] from ovn-kubernetes 56m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x 56m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled up replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 4 to 5 56m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Container started 56m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Container created 56m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused 56m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused... 56m Normal AddedLabel gateway/e2e-ait-bed6793d Added label istio.io/rev=openshift-gateway to gateway e2e-ait-bed6793d 56m Normal AddedLabel gateway/e2e-migrate-d56d1199-gw Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d56d1199-gw 56m Normal ScalingReplicaSet deployment/e2e-migrate-d56d1199-gw-openshift-default Scaled up replica set e2e-migrate-d56d1199-gw-openshift-default-b79f87457 from 0 to 1 56m Normal SuccessfulCreate replicaset/e2e-migrate-d56d1199-gw-openshift-default-b79f87457 Created pod: e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn 56m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Add eth0 [10.132.0.92/23] from ovn-kubernetes 56m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal ScalingReplicaSet deployment/e2e-ait-bed6793d-openshift-default Scaled up replica set e2e-ait-bed6793d-openshift-default-649f995d97 from 0 to 1 56m Normal AddedInterface pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Add eth0 [10.134.0.74/23] from ovn-kubernetes 56m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled up replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 6 to 8 56m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 56m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn 56m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 56m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Add eth0 [10.133.0.130/23] from ovn-kubernetes 56m Normal SuccessfulCreate replicaset/e2e-ait-bed6793d-openshift-default-649f995d97 Created pod: e2e-ait-bed6793d-openshift-default-649f995d97-z44vc 56m Normal AddedInterface pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Add eth0 [10.134.0.75/23] from ovn-kubernetes 56m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused... 56m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused 56m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Container created 56m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Container started 56m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Container started 56m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Container created 56m Normal AddedLabel gateway/e2e-derive-385396af Added label istio.io/rev=openshift-gateway to gateway e2e-derive-385396af 56m Normal AddedInterface pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Add eth0 [10.133.0.131/23] from ovn-kubernetes 56m Normal SuccessfulCreate replicaset/e2e-derive-385396af-openshift-default-5cf97b5c97 Created pod: e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n 56m Normal ScalingReplicaSet deployment/e2e-derive-385396af-openshift-default Scaled up replica set e2e-derive-385396af-openshift-default-5cf97b5c97 from 0 to 1 56m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused... 56m Normal ScalingReplicaSet deployment/payload-processing-e2e-migrate-d56d1199 Scaled up replica set payload-processing-e2e-migrate-d56d1199-5b88959bcf from 0 to 1 56m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused 56m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused 56m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused... 56m Warning FailedCreate replicaset/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f Error creating: pods "payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d56d1199: serviceaccount "payload-processing-e2e-migrate-d56d1199" not found 56m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f Created pod: payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n 56m Normal SuccessfulCreate replicaset/payload-processing-e2e-migrate-d56d1199-5b88959bcf Created pod: payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk 56m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-migrate-d56d1199 Scaled up replica set payload-pre-processing-e2e-migrate-d56d1199-68d587b47f from 0 to 1 56m Warning FailedCreate replicaset/payload-processing-e2e-migrate-d56d1199-5b88959bcf Error creating: pods "payload-processing-e2e-migrate-d56d1199-5b88959bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d56d1199: serviceaccount "payload-processing-e2e-migrate-d56d1199" not found 56m Normal Created pod/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n Container created 56m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Container created 56m Normal Created pod/payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk Container created 56m Normal Pulled pod/payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 56m Normal Pulled pod/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 56m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled up replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 8 to 10 56m Normal Started pod/payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk Container started 56m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 56m Normal Started pod/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n Container started 56m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Add eth0 [10.133.0.133/23] from ovn-kubernetes 56m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Container created 56m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Container started 56m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Container started 56m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Add eth0 [10.134.0.78/23] from ovn-kubernetes 56m Normal AddedInterface pod/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n Add eth0 [10.134.0.77/23] from ovn-kubernetes 56m Normal AddedInterface pod/payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk Add eth0 [10.134.0.76/23] from ovn-kubernetes 56m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h 56m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c (combined from similar events): Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl 56m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 56m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled up replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 8 to 10 56m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc Created pod: payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t 56m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-bed6793d Scaled up replica set payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc from 0 to 1 56m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Add eth0 [10.132.0.93/23] from ovn-kubernetes 56m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl 56m Normal SuccessfulCreate replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 (combined from similar events): Created pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh 56m Warning FailedCreate replicaset/payload-processing-e2e-ait-bed6793d-55c96cb599 Error creating: pods "payload-processing-e2e-ait-bed6793d-55c96cb599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bed6793d: serviceaccount "payload-processing-e2e-ait-bed6793d" not found 56m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-bed6793d Scaled up replica set payload-processing-e2e-ait-bed6793d-55c96cb599 from 0 to 1 56m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc Error creating: pods "payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-bed6793d: serviceaccount "payload-processing-e2e-ait-bed6793d" not found 56m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused... 56m Normal AddedInterface pod/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t Add eth0 [10.133.0.134/23] from ovn-kubernetes 56m Normal Pulled pod/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 56m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Container started 56m Normal Created pod/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t Container created 56m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-bed6793d-55c96cb599 Created pod: payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf 56m Normal Started pod/payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf Container started 56m Normal AddedInterface pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Add eth0 [10.134.0.79/23] from ovn-kubernetes 56m Normal Started pod/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t Container started 56m Normal Started pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Container started 56m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused 56m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused 56m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Container created 56m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused... 56m Normal AddedInterface pod/payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf Add eth0 [10.133.0.135/23] from ovn-kubernetes 56m Normal Pulled pod/payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 56m Normal Created pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Container created 56m Normal Pulled pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal Created pod/payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf Container created 56m Normal ScalingReplicaSet deployment/payload-processing-e2e-derive-385396af Scaled up replica set payload-processing-e2e-derive-385396af-64b8655bd5 from 0 to 1 56m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-derive-385396af Scaled up replica set payload-pre-processing-e2e-derive-385396af-7b485d4b5f from 0 to 1 56m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-derive-385396af-7b485d4b5f Created pod: payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm 56m Warning FailedCreate replicaset/payload-processing-e2e-derive-385396af-64b8655bd5 Error creating: pods "payload-processing-e2e-derive-385396af-64b8655bd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-385396af: serviceaccount "payload-processing-e2e-derive-385396af" not found 56m Normal SuccessfulCreate replicaset/payload-processing-e2e-derive-385396af-64b8655bd5 Created pod: payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 56m Warning FailedCreate replicaset/payload-pre-processing-e2e-derive-385396af-7b485d4b5f Error creating: pods "payload-pre-processing-e2e-derive-385396af-7b485d4b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-385396af: serviceaccount "payload-processing-e2e-derive-385396af" not found 56m Normal AddedInterface pod/payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm Add eth0 [10.133.0.137/23] from ovn-kubernetes 56m Normal Pulled pod/payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 56m Normal Started pod/payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm Container started 56m Normal Pulled pod/payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 56m Normal Started pod/payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 Container started 56m Normal Created pod/payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 Container created 56m Normal AddedInterface pod/payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 Add eth0 [10.134.0.80/23] from ovn-kubernetes 56m Normal Created pod/payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm Container created 56m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2 56m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-4hmln 56m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 2; reason: cpu resource utilization (percentage of request) above target 56m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Add eth0 [10.132.0.94/23] from ovn-kubernetes 56m Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 56m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused... 56m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused 56m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused 56m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused... 56m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 (combined from similar events): Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 56m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 56m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Readiness probe error: Get "http://10.133.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 56m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Readiness probe failed: Get "http://10.133.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 56m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled up replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 8 to 10 56m Normal SuccessfulCreate replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Created pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf 56m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 56m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 56m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 56m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 56m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 56m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 56m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 56m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 56m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 56m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 56m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Container created 56m Normal Created pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Container created 56m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Container started 56m Normal Started pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Container started 56m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Add eth0 [10.133.0.138/23] from ovn-kubernetes 56m Normal Pulled pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 56m Normal AddedInterface pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Add eth0 [10.133.0.139/23] from ovn-kubernetes 56m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Container started 56m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Container created 56m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 11.181s (11.181s including waiting). Image size: 185476477 bytes. 56m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Readiness probe error: HTTP probe failed with statuscode: 503... 56m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln Readiness probe failed: HTTP probe failed with statuscode: 503 56m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused... 56m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused... 56m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused 56m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused 55m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Add eth0 [10.133.0.140/23] from ovn-kubernetes 55m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Add eth0 [10.132.0.95/23] from ovn-kubernetes 55m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled up replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 5 to 10 55m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 55m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 (combined from similar events): Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f 55m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 55m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg 55m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks 55m Normal SuccessfulCreate replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Created pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c 55m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Add eth0 [10.133.0.141/23] from ovn-kubernetes 55m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Add eth0 [10.134.0.83/23] from ovn-kubernetes 55m Normal AddedInterface pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Add eth0 [10.134.0.82/23] from ovn-kubernetes 55m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Container started 55m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Container created 55m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Container created 55m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Container started 55m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Container started 55m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Container created 55m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Container created 55m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Container started 55m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Started pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Container started 55m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Pulled pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Created pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Container created 55m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused 55m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused 55m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused 55m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused 55m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused 55m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused... 55m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-nsqr4 55m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-bc7r2 55m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-hqlmj 55m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Container started 55m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Container created 55m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Add eth0 [10.132.0.97/23] from ovn-kubernetes 55m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Container created 55m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Container started 55m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Add eth0 [10.133.0.142/23] from ovn-kubernetes 55m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Container started 55m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Add eth0 [10.134.0.85/23] from ovn-kubernetes 55m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Container created 55m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal ScalingReplicaSet deployment/e2e-ait-bed6793d-openshift-default Scaled up replica set e2e-ait-bed6793d-openshift-default-649f995d97 from 1 to 4 55m Normal SuccessfulRescale horizontalpodautoscaler/e2e-ait-bed6793d-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 55m Normal SuccessfulCreate replicaset/e2e-ait-bed6793d-openshift-default-649f995d97 Created pod: e2e-ait-bed6793d-openshift-default-649f995d97-424pm 55m Normal SuccessfulCreate replicaset/e2e-ait-bed6793d-openshift-default-649f995d97 Created pod: e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz 55m Normal SuccessfulCreate replicaset/e2e-ait-bed6793d-openshift-default-649f995d97 Created pod: e2e-ait-bed6793d-openshift-default-649f995d97-2rptf 55m Normal Pulled pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal AddedInterface pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Add eth0 [10.133.0.143/23] from ovn-kubernetes 55m Normal AddedInterface pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Add eth0 [10.134.0.86/23] from ovn-kubernetes 55m Normal AddedInterface pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Add eth0 [10.132.0.98/23] from ovn-kubernetes 55m Normal Pulled pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Created pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Container created 55m Normal Started pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Container started 55m Normal Pulled pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Created pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Container created 55m Normal Created pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Container created 55m Normal Started pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Container started 55m Normal Started pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Container started 55m Normal Started pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Container started 55m Normal Pulled pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Created pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Container created 55m Warning Unhealthy pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 55m Warning Unhealthy pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 55m Warning ProbeError pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 55m Warning ProbeError pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 55m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused 55m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused... 55m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused 55m Normal Started pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Container started 55m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused... 55m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused... 55m Normal Pulled pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Pulled pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 55m Normal Created pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Container created 55m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused 55m Normal Created pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Container created 55m Normal Started pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Container started 55m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 55m Warning ProbeError pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused... 55m Warning ProbeError pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused 55m Warning Unhealthy pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused 55m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 55m Warning ProbeError pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused 55m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 55m Warning ProbeError pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused 55m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 55m Warning Unhealthy pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused 55m Warning ProbeError pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused... 55m Warning ProbeError pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused... 55m Warning Unhealthy pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused 55m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-migrate-d56d1199-gw-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 55m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-migrate-d56d1199-gw-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 55m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-bed6793d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 55m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-bed6793d-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 55m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-derive-385396af-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 55m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-derive-385396af-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 54m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-migrate-d56d1199-gw-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 54m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-migrate-d56d1199-gw-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 54m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-bed6793d-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 54m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-bed6793d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 54m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-derive-385396af-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 54m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-derive-385396af-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 54m Normal Killing pod/payload-pre-processing-e2e-migrate-d56d1199-68d587b47f-h5c8n Stopping container payload-pre-processing 54m Normal Killing pod/payload-processing-e2e-migrate-d56d1199-5b88959bcf-5khrk Stopping container payload-processing 54m Normal Killing pod/payload-processing-e2e-derive-385396af-64b8655bd5-tckp2 Stopping container payload-processing 54m Normal Killing pod/payload-pre-processing-e2e-derive-385396af-7b485d4b5f-9qcpm Stopping container payload-pre-processing 54m Normal Killing pod/payload-processing-e2e-ait-bed6793d-55c96cb599-fxkmf Stopping container payload-processing 54m Normal Killing pod/payload-pre-processing-e2e-ait-bed6793d-5d84c8c5bc-qxh2t Stopping container payload-pre-processing 54m Normal ScalingReplicaSet deployment/e2e-shared-a-w0-3b21b4-openshift-default Scaled up replica set e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f from 0 to 1 54m Normal AddedLabel gateway/e2e-shared-a-w0-3b21b4 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-3b21b4 54m Normal SuccessfulCreate replicaset/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f Created pod: e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx 54m Normal AddedInterface pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Add eth0 [10.134.0.87/23] from ovn-kubernetes 54m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5 Error creating: pods "payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3b21b4: serviceaccount "payload-processing-e2e-shared-a-w0-3b21b4" not found 54m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w0-3b21b4 Scaled up replica set payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7 from 0 to 1 54m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w0-3b21b4 Scaled up replica set payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5 from 0 to 1 54m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7 Error creating: pods "payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3b21b4: serviceaccount "payload-processing-e2e-shared-a-w0-3b21b4" not found 54m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5 Created pod: payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx 54m Normal AddedInterface pod/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx Add eth0 [10.133.0.149/23] from ovn-kubernetes 54m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 Add eth0 [10.133.0.148/23] from ovn-kubernetes 54m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 54m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7 Created pod: payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 54m Normal Created pod/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx Container created 54m Normal Created pod/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 Container created 54m Normal Started pod/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 Container started 54m Normal Started pod/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx Container started 54m Normal Pulled pod/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 54m Normal Killing pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Stopping container istio-proxy 54m Normal Killing pod/e2e-ait-bed6793d-openshift-default-649f995d97-tmgmz Stopping container istio-proxy 54m Normal Killing pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf Stopping container istio-proxy 54m Normal Killing pod/e2e-ait-bed6793d-openshift-default-649f995d97-424pm Stopping container istio-proxy 54m Normal Killing pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Stopping container istio-proxy 54m Normal ScalingReplicaSet deployment/e2e-ait-9173600a-openshift-default Scaled up replica set e2e-ait-9173600a-openshift-default-5668bd4ccf from 0 to 1 54m Normal AddedLabel gateway/e2e-ait-9173600a Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9173600a 54m Normal SuccessfulCreate replicaset/e2e-ait-9173600a-openshift-default-5668bd4ccf Created pod: e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 54m Normal Killing pod/e2e-derive-385396af-openshift-default-5cf97b5c97-zxc9n Stopping container istio-proxy 54m Normal AddedInterface pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Add eth0 [10.134.0.88/23] from ovn-kubernetes 54m Warning Unhealthy pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Readiness probe failed: HTTP probe failed with statuscode: 503 54m Warning Unhealthy pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Readiness probe failed: HTTP probe failed with statuscode: 503 54m Warning ProbeError pod/e2e-ait-bed6793d-openshift-default-649f995d97-z44vc Readiness probe error: HTTP probe failed with statuscode: 503... 54m Warning ProbeError pod/e2e-migrate-d56d1199-gw-openshift-default-b79f87457-8rffn Readiness probe error: HTTP probe failed with statuscode: 503... 54m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7 Error creating: pods "payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9173600a: serviceaccount "payload-processing-e2e-ait-9173600a" not found 54m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7 Created pod: payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs 54m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-9173600a Scaled up replica set payload-pre-processing-e2e-ait-9173600a-5d8c7564d7 from 0 to 1 54m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-9173600a Scaled up replica set payload-processing-e2e-ait-9173600a-6bbdfc7b89 from 0 to 1 54m Warning FailedCreate replicaset/payload-processing-e2e-ait-9173600a-6bbdfc7b89 Error creating: pods "payload-processing-e2e-ait-9173600a-6bbdfc7b89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9173600a: serviceaccount "payload-processing-e2e-ait-9173600a" not found 54m Normal AddedLabel gateway/e2e-ait-1915737c Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1915737c 54m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-9173600a-6bbdfc7b89 Created pod: payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 54m Normal SuccessfulCreate replicaset/e2e-ait-1915737c-openshift-default-5f568c4bf7 Created pod: e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 54m Normal ScalingReplicaSet deployment/e2e-ait-1915737c-openshift-default Scaled up replica set e2e-ait-1915737c-openshift-default-5f568c4bf7 from 0 to 1 54m Normal Created pod/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs Container created 54m Normal Pulled pod/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Add eth0 [10.134.0.91/23] from ovn-kubernetes 54m Normal Started pod/payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 Container started 54m Normal AddedInterface pod/payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 Add eth0 [10.134.0.90/23] from ovn-kubernetes 54m Normal Pulled pod/payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs Add eth0 [10.134.0.89/23] from ovn-kubernetes 54m Normal Created pod/payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 Container created 54m Normal Started pod/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs Container started 53m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-9173600a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 53m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-9173600a-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 53m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-qjkt6 53m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-lbxq2 53m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-1915737c Scaled up replica set payload-pre-processing-e2e-ait-1915737c-c7894687f from 0 to 1 53m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-1915737c Scaled up replica set payload-processing-e2e-ait-1915737c-9d5ffb579 from 0 to 1 53m Warning FailedCreate replicaset/payload-processing-e2e-ait-1915737c-9d5ffb579 Error creating: pods "payload-processing-e2e-ait-1915737c-9d5ffb579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1915737c: serviceaccount "payload-processing-e2e-ait-1915737c" not found 53m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-pg8wh 53m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-1915737c-c7894687f Error creating: pods "payload-pre-processing-e2e-ait-1915737c-c7894687f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1915737c: serviceaccount "payload-processing-e2e-ait-1915737c" not found 53m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-nb6hp 53m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Container started 53m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Container started 53m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 53m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-1915737c-c7894687f Created pod: payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv 53m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Add eth0 [10.134.0.92/23] from ovn-kubernetes 53m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Container created 53m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Container started 53m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-1915737c-9d5ffb579 Created pod: payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz 53m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Container created 53m Normal AddedInterface pod/payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz Add eth0 [10.133.0.152/23] from ovn-kubernetes 53m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Container started 53m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Add eth0 [10.133.0.150/23] from ovn-kubernetes 53m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Add eth0 [10.134.0.93/23] from ovn-kubernetes 53m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 53m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Container created 53m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 53m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Container created 53m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Add eth0 [10.132.0.99/23] from ovn-kubernetes 53m Normal Created pod/payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz Container created 53m Normal Pulled pod/payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 53m Normal Started pod/payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv Container started 53m Normal Created pod/payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv Container created 53m Normal Pulled pod/payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv Add eth0 [10.133.0.151/23] from ovn-kubernetes 53m Normal Started pod/payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz Container started 53m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused 53m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused 53m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused... 53m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused... 53m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused 53m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused... 53m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused 53m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused... 53m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default (combined from similar events): New size: 9; reason: 53m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-hdc94 53m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Container created 53m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Add eth0 [10.132.0.100/23] from ovn-kubernetes 53m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Container started 53m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 53m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused 53m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused... 53m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Readiness probe error: Get "http://10.133.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 53m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Readiness probe failed: Get "http://10.133.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 53m Normal ScalingReplicaSet deployment/e2e-shared-a-w1-2ace1d-openshift-default Scaled up replica set e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57 from 0 to 1 53m Normal SuccessfulCreate replicaset/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57 Created pod: e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt 53m Normal AddedLabel gateway/e2e-shared-a-w1-2ace1d Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-2ace1d 53m Normal AddedInterface pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Add eth0 [10.133.0.153/23] from ovn-kubernetes 53m Normal AddedLabel gateway/e2e-mt-29b7ead1 Added label istio.io/rev=openshift-gateway to gateway e2e-mt-29b7ead1 53m Normal ScalingReplicaSet deployment/e2e-mt-29b7ead1-openshift-default Scaled up replica set e2e-mt-29b7ead1-openshift-default-866d97fb49 from 0 to 1 53m Normal SuccessfulCreate replicaset/e2e-mt-29b7ead1-openshift-default-866d97fb49 Created pod: e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd 53m Normal AddedInterface pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Add eth0 [10.133.0.154/23] from ovn-kubernetes 53m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w1-2ace1d Scaled up replica set payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55 from 0 to 1 53m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55 Error creating: pods "payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-2ace1d: serviceaccount "payload-processing-e2e-shared-a-w1-2ace1d" not found 53m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w1-2ace1d Scaled up replica set payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699 from 0 to 1 53m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699 Created pod: payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 53m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55 Created pod: payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns 53m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 Add eth0 [10.133.0.155/23] from ovn-kubernetes 53m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 53m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699 Error creating: pods "payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-2ace1d: serviceaccount "payload-processing-e2e-shared-a-w1-2ace1d" not found 53m Normal Started pod/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 Container started 53m Normal Created pod/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 Container created 53m Normal Created pod/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns Container created 53m Normal Pulled pod/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 53m Normal Started pod/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns Container started 53m Normal AddedInterface pod/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns Add eth0 [10.133.0.156/23] from ovn-kubernetes 53m Warning ProbeError pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Readiness probe error: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 53m Warning Unhealthy pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Readiness probe failed: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 52m Normal Created pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Container created 52m Normal Pulled pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 52m Normal Started pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Container started 52m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-29b7ead1 Scaled up replica set payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7 from 0 to 1 52m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-29b7ead1 Scaled up replica set payload-processing-e2e-mt-29b7ead1-747f6b9c57 from 0 to 1 52m Warning FailedCreate replicaset/payload-processing-e2e-mt-29b7ead1-747f6b9c57 Error creating: pods "payload-processing-e2e-mt-29b7ead1-747f6b9c57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-29b7ead1: serviceaccount "payload-processing-e2e-mt-29b7ead1" not found 52m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7 Created pod: payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz 52m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7 Error creating: pods "payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-29b7ead1: serviceaccount "payload-processing-e2e-mt-29b7ead1" not found 52m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-fzjdh 52m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 52m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-29b7ead1-747f6b9c57 Created pod: payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 52m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default (combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 9 to 10 52m Normal Pulled pod/payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 52m Normal Created pod/payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 Container created 52m Normal Pulled pod/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Add eth0 [10.134.0.96/23] from ovn-kubernetes 52m Normal Started pod/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz Container started 52m Normal Created pod/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz Container created 52m Normal AddedInterface pod/payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 Add eth0 [10.133.0.158/23] from ovn-kubernetes 52m Normal AddedInterface pod/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz Add eth0 [10.133.0.157/23] from ovn-kubernetes 52m Normal Started pod/payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 Container started 52m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 52m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Container created 52m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Container started 52m Warning ProbeError pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused... 52m Warning Unhealthy pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused 52m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w0-3b21b4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 52m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w0-3b21b4-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 52m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused... 52m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused 52m Warning ProbeError pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 52m Normal Created pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Container created 52m Normal Started pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Container started 52m Normal Pulled pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 52m Warning Unhealthy pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 52m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w0-3b21b4-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 52m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w0-3b21b4-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 52m Warning ProbeError pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused... 52m Warning Unhealthy pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused 52m Normal AddedLabel gateway/e2e-shared-b-w0-d6a241 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-d6a241 52m Normal SuccessfulCreate replicaset/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949 Created pod: e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk 52m Normal ScalingReplicaSet deployment/e2e-shared-b-w0-d6a241-openshift-default Scaled up replica set e2e-shared-b-w0-d6a241-openshift-default-6694b6c949 from 0 to 1 52m Normal AddedInterface pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Add eth0 [10.132.0.102/23] from ovn-kubernetes 52m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w0-d6a241 Scaled up replica set payload-processing-e2e-shared-b-w0-d6a241-867b98b47 from 0 to 1 52m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9 Error creating: pods "payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-d6a241: serviceaccount "payload-processing-e2e-shared-b-w0-d6a241" not found 52m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w0-d6a241-867b98b47 Created pod: payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj 52m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w0-d6a241 Scaled up replica set payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9 from 0 to 1 52m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w0-d6a241-867b98b47 Error creating: pods "payload-processing-e2e-shared-b-w0-d6a241-867b98b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-d6a241: serviceaccount "payload-processing-e2e-shared-b-w0-d6a241" not found 52m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9 Created pod: payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr 52m Normal AddedInterface pod/payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj Add eth0 [10.133.0.161/23] from ovn-kubernetes 52m Normal Pulled pod/payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 52m Normal Created pod/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr Container created 52m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 52m Normal Started pod/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr Container started 52m Normal Created pod/payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj Container created 52m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr Add eth0 [10.133.0.160/23] from ovn-kubernetes 52m Normal Started pod/payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj Container started 52m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-9173600a-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 52m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-9173600a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 52m Normal Killing pod/payload-processing-e2e-ait-9173600a-6bbdfc7b89-jkf72 Stopping container payload-processing 52m Normal Killing pod/payload-pre-processing-e2e-ait-9173600a-5d8c7564d7-j7lzs Stopping container payload-pre-processing 51m Normal Started pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Container started 51m Normal Pulled pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal Created pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Container created 51m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-1915737c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 51m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-1915737c-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 51m Normal Killing pod/payload-processing-e2e-ait-1915737c-9d5ffb579-5fzrz Stopping container payload-processing 51m Normal Killing pod/payload-pre-processing-e2e-ait-1915737c-c7894687f-wtnxv Stopping container payload-pre-processing 51m Warning ProbeError pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused... 51m Warning Unhealthy pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused 51m Warning ProbeError pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Readiness probe error: Get "http://10.133.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 51m Warning Unhealthy pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Readiness probe failed: Get "http://10.133.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 51m Normal Started pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Container started 51m Normal Started pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Container started 51m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Stopping container istio-proxy 51m Normal Created pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Container created 51m Warning Unhealthy pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Readiness probe failed: Get "http://10.133.0.154:15021/healthz/ready": read tcp 10.133.0.2:52000->10.133.0.154:15021: read: connection reset by peer 51m Warning ProbeError pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Readiness probe error: Get "http://10.133.0.154:15021/healthz/ready": read tcp 10.133.0.2:52000->10.133.0.154:15021: read: connection reset by peer... 51m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf 51m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 7; reason: All metrics below target 51m Normal Pulled pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp 51m Normal Pulled pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 51m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 Stopping container istio-proxy 51m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled down replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 10 to 7 51m Normal Created pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Container created 51m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-792g8 51m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-rj6gf Stopping container istio-proxy 51m Normal Killing pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Stopping container istio-proxy 51m Normal SuccessfulDelete replicaset/e2e-worker-w3-9796f1-openshift-default-5547cf6495 Deleted pod: e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp 51m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-9796f1-openshift-default New size: 2; reason: All metrics below target 51m Normal ScalingReplicaSet deployment/e2e-worker-w3-9796f1-openshift-default Scaled down replica set e2e-worker-w3-9796f1-openshift-default-5547cf6495 from 4 to 2 51m Normal SuccessfulDelete replicaset/e2e-worker-w3-9796f1-openshift-default-5547cf6495 Deleted pod: e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 51m Normal Killing pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 Stopping container istio-proxy 51m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Readiness probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused 51m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-zb4hp Readiness probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused... 51m Warning ProbeError pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Startup probe error: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused... 51m Warning ProbeError pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused... 51m Warning Unhealthy pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Startup probe failed: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused 51m Warning Unhealthy pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused 51m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused 51m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused... 51m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w1-2ace1d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 51m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w1-2ace1d-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 51m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-29b7ead1-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 51m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-29b7ead1-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 51m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Stopping container istio-proxy 51m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb 51m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled down replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 7 to 5 51m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z 51m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z Stopping container istio-proxy 51m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 5; reason: All metrics below target 51m Normal AddedLabel gateway/e2e-shared-a-w4-218800 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-218800 51m Normal SuccessfulCreate replicaset/e2e-shared-a-w4-218800-openshift-default-7888c6d55c Created pod: e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd 51m Normal ScalingReplicaSet deployment/e2e-shared-a-w4-218800-openshift-default Scaled up replica set e2e-shared-a-w4-218800-openshift-default-7888c6d55c from 0 to 1 51m Normal AddedInterface pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Add eth0 [10.133.0.172/23] from ovn-kubernetes 51m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk 51m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh 51m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled down replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 10 to 5 51m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 5; reason: All metrics below target 51m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh Stopping container istio-proxy 51m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn 51m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 51m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 51m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Stopping container istio-proxy 51m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn Stopping container istio-proxy 51m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Stopping container istio-proxy 51m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-7qvf9 Stopping container istio-proxy 51m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 6; reason: All metrics below target 51m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc 51m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Stopping container istio-proxy 51m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-rg7dc Stopping container istio-proxy 51m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb 51m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x 51m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 51m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Stopping container istio-proxy 51m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-wtpr7 Stopping container istio-proxy 51m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled down replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 10 to 6 51m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Readiness probe failed: HTTP probe failed with statuscode: 503 51m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb Readiness probe error: HTTP probe failed with statuscode: 503... 51m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Readiness probe failed: HTTP probe failed with statuscode: 503 51m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 Readiness probe error: HTTP probe failed with statuscode: 503... 51m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Readiness probe error: HTTP probe failed with statuscode: 503... 51m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-1915737c-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 51m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-k2l6x Readiness probe failed: HTTP probe failed with statuscode: 503 51m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Readiness probe failed: HTTP probe failed with statuscode: 503 51m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-1915737c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 51m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-8snjb Readiness probe error: HTTP probe failed with statuscode: 503... 51m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused... 51m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f Error creating: pods "payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-218800: serviceaccount "payload-processing-e2e-shared-a-w4-218800" not found 51m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-a-w4-218800 Scaled up replica set payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc from 0 to 1 51m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f Created pod: payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg 51m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc Created pod: payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 51m Normal Killing pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Stopping container istio-proxy 51m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-a-w4-218800 Scaled up replica set payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f from 0 to 1 51m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused 51m Warning FailedCreate replicaset/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc Error creating: pods "payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-218800: serviceaccount "payload-processing-e2e-shared-a-w4-218800" not found 50m Normal Pulled pod/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 50m Normal Created pod/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg Container created 50m Normal AddedInterface pod/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 Add eth0 [10.133.0.174/23] from ovn-kubernetes 50m Normal AddedInterface pod/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg Add eth0 [10.133.0.173/23] from ovn-kubernetes 50m Normal Pulled pod/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 50m Normal Created pod/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 Container created 50m Normal Started pod/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 Container started 50m Warning Unhealthy pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Readiness probe failed: HTTP probe failed with statuscode: 503 50m Normal Started pod/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg Container started 50m Warning ProbeError pod/e2e-ait-9173600a-openshift-default-5668bd4ccf-96z95 Readiness probe error: HTTP probe failed with statuscode: 503... 50m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr Stopping container istio-proxy 50m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 50m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled down replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 10 to 9 50m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default New size: 9; reason: All metrics below target 50m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 5; reason: All metrics below target 50m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 50m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg Stopping container istio-proxy 50m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-mzxf7 Stopping container istio-proxy 50m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl Stopping container istio-proxy 50m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x Stopping container istio-proxy 50m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9vkz2 Stopping container istio-proxy 50m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-9w4nl 50m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-p6b2x 50m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-ljzrg 50m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr 50m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled down replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 10 to 5 50m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-29b7ead1-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 50m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-29b7ead1-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 50m Normal Killing pod/e2e-ait-1915737c-openshift-default-5f568c4bf7-69xc8 Stopping container istio-proxy 50m Normal AddedLabel gateway/e2e-shared-b-w1-3ddec2 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-3ddec2 50m Normal AddedInterface pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Add eth0 [10.132.0.107/23] from ovn-kubernetes 50m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Created pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg 50m Normal ScalingReplicaSet deployment/e2e-shared-b-w1-3ddec2-openshift-default Scaled up replica set e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 from 0 to 1 50m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w1-2ace1d-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 50m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w1-2ace1d-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 50m Normal AddedLabel gateway/e2e-api-a-fbb72e Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-fbb72e 50m Normal ScalingReplicaSet deployment/e2e-api-a-fbb72e-openshift-default Scaled up replica set e2e-api-a-fbb72e-openshift-default-cf57d8c7 from 0 to 1 50m Normal SuccessfulCreate replicaset/e2e-api-a-fbb72e-openshift-default-cf57d8c7 Created pod: e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc 50m Normal Created pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Container created 50m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c 50m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default New size: 5; reason: All metrics below target 50m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks 50m Normal AddedInterface pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Add eth0 [10.132.0.108/23] from ovn-kubernetes 50m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f 50m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9zvks Stopping container istio-proxy 50m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg 50m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-gps5c Stopping container istio-proxy 50m Normal Pulled pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 50m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-w8b4f Stopping container istio-proxy 50m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-jvngg Stopping container istio-proxy 50m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled down replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 9 to 5 50m Normal Started pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Container started 50m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w1-3ddec2 Scaled up replica set payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9 from 0 to 1 50m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979 Error creating: pods "payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-3ddec2: serviceaccount "payload-processing-e2e-shared-b-w1-3ddec2" not found 50m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9 Created pod: payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt 50m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9 Error creating: pods "payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-3ddec2: serviceaccount "payload-processing-e2e-shared-b-w1-3ddec2" not found 50m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w1-3ddec2 Scaled up replica set payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979 from 0 to 1 50m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979 Created pod: payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q 50m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w4-218800-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 50m Normal Pulled pod/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 50m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w4-218800-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 50m Normal Started pod/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt Container started 50m Normal Created pod/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt Container created 50m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q Add eth0 [10.134.0.100/23] from ovn-kubernetes 50m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 50m Normal Created pod/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q Container created 50m Normal Started pod/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q Container started 50m Normal AddedInterface pod/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt Add eth0 [10.133.0.175/23] from ovn-kubernetes 50m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 50m Warning Unhealthy pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused 50m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f 50m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Stopping container istio-proxy 50m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb Stopping container istio-proxy 50m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Stopping container istio-proxy 50m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 6; reason: All metrics below target 50m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled down replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 10 to 6 50m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Stopping container istio-proxy 50m Warning ProbeError pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused... 50m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 50m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-q57mb 50m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-fbb72e Scaled up replica set payload-processing-e2e-api-a-fbb72e-5575659479 from 0 to 1 50m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-fbb72e Scaled up replica set payload-pre-processing-e2e-api-a-fbb72e-6d9c658687 from 0 to 1 50m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-fbb72e-5575659479 Created pod: payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv 50m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687 Error creating: pods "payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fbb72e: serviceaccount "payload-processing-e2e-api-a-fbb72e" not found 50m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Readiness probe failed: HTTP probe failed with statuscode: 503 50m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-4wb4f Readiness probe error: HTTP probe failed with statuscode: 503... 50m Warning FailedCreate replicaset/payload-processing-e2e-api-a-fbb72e-5575659479 Error creating: pods "payload-processing-e2e-api-a-fbb72e-5575659479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fbb72e: serviceaccount "payload-processing-e2e-api-a-fbb72e" not found 50m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687 Created pod: payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc 50m Normal Started pod/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc Container started 50m Normal Pulled pod/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 50m Normal Started pod/payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv Container started 50m Normal AddedInterface pod/payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv Add eth0 [10.133.0.177/23] from ovn-kubernetes 50m Normal Created pod/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc Container created 50m Normal Pulled pod/payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 50m Normal Created pod/payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv Container created 50m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc Add eth0 [10.133.0.176/23] from ovn-kubernetes 50m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Readiness probe failed: HTTP probe failed with statuscode: 503 50m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Readiness probe failed: HTTP probe failed with statuscode: 503 50m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-hrjp4 Readiness probe error: HTTP probe failed with statuscode: 503... 50m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tq552 Readiness probe error: HTTP probe failed with statuscode: 503... 50m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w0-d6a241-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 50m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w0-d6a241-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 50m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w0-d6a241-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 50m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w0-d6a241-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 49m Normal SuccessfulCreate replicaset/e2e-api-a-b34958-openshift-default-559d74f555 Created pod: e2e-api-a-b34958-openshift-default-559d74f555-htq4p 49m Normal ScalingReplicaSet deployment/e2e-api-a-b34958-openshift-default Scaled up replica set e2e-api-a-b34958-openshift-default-559d74f555 from 0 to 1 49m Normal AddedLabel gateway/e2e-api-a-b34958 Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b34958 49m Normal AddedInterface pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Add eth0 [10.133.0.183/23] from ovn-kubernetes 49m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-b34958 Scaled up replica set payload-pre-processing-e2e-api-a-b34958-74cf77fb79 from 0 to 1 49m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-b34958-74cf77fb79 Created pod: payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp 49m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-b34958-74cf77fb79 Error creating: pods "payload-pre-processing-e2e-api-a-b34958-74cf77fb79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b34958: serviceaccount "payload-processing-e2e-api-a-b34958" not found 49m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-b34958 Scaled up replica set payload-processing-e2e-api-a-b34958-9786989c7 from 0 to 1 49m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-b34958-9786989c7 Created pod: payload-processing-e2e-api-a-b34958-9786989c7-lcprk 49m Warning FailedCreate replicaset/payload-processing-e2e-api-a-b34958-9786989c7 Error creating: pods "payload-processing-e2e-api-a-b34958-9786989c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b34958: serviceaccount "payload-processing-e2e-api-a-b34958" not found 49m Normal Pulled pod/payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 49m Normal Pulled pod/payload-processing-e2e-api-a-b34958-9786989c7-lcprk Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 49m Normal Created pod/payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp Container created 49m Normal AddedInterface pod/payload-processing-e2e-api-a-b34958-9786989c7-lcprk Add eth0 [10.133.0.185/23] from ovn-kubernetes 49m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp Add eth0 [10.133.0.184/23] from ovn-kubernetes 49m Normal Started pod/payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp Container started 49m Normal Started pod/payload-processing-e2e-api-a-b34958-9786989c7-lcprk Container started 49m Normal Created pod/payload-processing-e2e-api-a-b34958-9786989c7-lcprk Container created 49m Normal ScalingReplicaSet deployment/e2e-shared-a-w4-218800-openshift-default Scaled up replica set e2e-shared-a-w4-218800-openshift-default-7888c6d55c from 1 to 3 49m Normal SuccessfulCreate replicaset/e2e-shared-a-w4-218800-openshift-default-7888c6d55c Created pod: e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 49m Normal SuccessfulCreate replicaset/e2e-shared-a-w4-218800-openshift-default-7888c6d55c Created pod: e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf 49m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w4-218800-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 49m Normal Pulled pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Created pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Container created 49m Normal Started pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Container started 49m Normal AddedInterface pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Add eth0 [10.134.0.103/23] from ovn-kubernetes 49m Normal AddedInterface pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Add eth0 [10.132.0.110/23] from ovn-kubernetes 49m Normal Pulled pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Created pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Container created 49m Normal Started pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Container started 49m Warning ProbeError pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Readiness probe error: Get "http://10.133.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 49m Warning Unhealthy pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Readiness probe failed: Get "http://10.133.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 49m Normal Pulled pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 49m Normal Created pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Container created 49m Normal Started pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Container started 49m Warning ProbeError pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused... 49m Warning Unhealthy pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused 49m Warning ProbeError pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused... 49m Warning Unhealthy pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused 49m Warning Unhealthy pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Startup probe failed: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused 49m Warning ProbeError pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Startup probe error: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused... 49m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-a-w4-218800-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 49m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-a-w4-218800-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning ProbeError pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Readiness probe error: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 48m Warning Unhealthy pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Readiness probe failed: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 48m Normal Killing pod/payload-processing-e2e-mt-29b7ead1-747f6b9c57-5twv8 Stopping container payload-processing 48m Normal Killing pod/payload-pre-processing-e2e-mt-29b7ead1-74ffb48bb7-tt5qz Stopping container payload-pre-processing 48m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl Stopping container istio-proxy 48m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default Scaled down replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 5 to 4 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 4; reason: All metrics below target 48m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-zg7bl 48m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr 48m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Stopping container istio-proxy 48m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Stopping container istio-proxy 48m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled down replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 6 to 4 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 4; reason: All metrics below target 48m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr 48m Normal Created pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Container created 48m Normal Pulled pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Started pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Container started 48m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Readiness probe failed: HTTP probe failed with statuscode: 503 48m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr Readiness probe error: HTTP probe failed with statuscode: 503... 48m Normal AddedInterface pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Add eth0 [10.134.0.104/23] from ovn-kubernetes 48m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Readiness probe failed: HTTP probe failed with statuscode: 503 48m Normal ScalingReplicaSet deployment/e2e-shared-b-w1-3ddec2-openshift-default Scaled up replica set e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 from 1 to 4 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 48m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr Readiness probe error: HTTP probe failed with statuscode: 503... 48m Normal Pulled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Created pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Container created 48m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Created pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l 48m Normal Started pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Container started 48m Normal AddedInterface pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Add eth0 [10.133.0.188/23] from ovn-kubernetes 48m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Created pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz 48m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Created pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj 48m Normal AddedInterface pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Add eth0 [10.133.0.189/23] from ovn-kubernetes 48m Normal Started pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Container started 48m Normal Created pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Container created 48m Normal Started pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Container started 48m Normal Created pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Container created 48m Normal Pulled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Pulled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Started pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Container started 48m Normal Pulled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 48m Normal Created pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Container created 48m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h 48m Warning Unhealthy pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused 48m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled down replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 5 to 4 48m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-hjl5h Stopping container istio-proxy 48m Warning ProbeError pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused... 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 4; reason: All metrics below target 48m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused... 48m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused... 48m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused... 48m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused 48m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused 48m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused 48m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 4; reason: All metrics below target 48m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused 48m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused... 48m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default Scaled down replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 5 to 4 48m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Stopping container istio-proxy 48m Normal SuccessfulCreate replicaset/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c Created pod: e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm 48m Normal ScalingReplicaSet deployment/e2e-shared-b-w4-013fb2-openshift-default Scaled up replica set e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c from 0 to 1 48m Normal AddedLabel gateway/e2e-shared-b-w4-013fb2 Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-013fb2 48m Normal AddedInterface pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Add eth0 [10.133.0.190/23] from ovn-kubernetes 48m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused... 48m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-qdxfh Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Normal AddedLabel gateway/e2e-api-a-4a1551 Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4a1551 48m Normal ScalingReplicaSet deployment/e2e-api-a-4a1551-openshift-default Scaled up replica set e2e-api-a-4a1551-openshift-default-5866f4745f from 0 to 1 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-fbb72e-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-fbb72e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 48m Normal SuccessfulCreate replicaset/e2e-api-a-4a1551-openshift-default-5866f4745f Created pod: e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn 48m Normal AddedInterface pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Add eth0 [10.134.0.105/23] from ovn-kubernetes 48m Normal Killing pod/e2e-mt-29b7ead1-openshift-default-866d97fb49-k9hnd Stopping container istio-proxy 48m Normal ScalingReplicaSet deployment/e2e-inf-a-50b188-openshift-default Scaled up replica set e2e-inf-a-50b188-openshift-default-768d545959 from 0 to 1 48m Normal SuccessfulCreate replicaset/e2e-inf-a-50b188-openshift-default-768d545959 Created pod: e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 48m Normal AddedLabel gateway/e2e-inf-a-50b188 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-50b188 48m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-a-4a1551 Scaled up replica set payload-processing-e2e-api-a-4a1551-57f4f89d9 from 0 to 1 48m Warning FailedCreate replicaset/payload-processing-e2e-api-a-4a1551-57f4f89d9 Error creating: pods "payload-processing-e2e-api-a-4a1551-57f4f89d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4a1551: serviceaccount "payload-processing-e2e-api-a-4a1551" not found 48m Normal AddedInterface pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Add eth0 [10.134.0.106/23] from ovn-kubernetes 48m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-a-4a1551 Scaled up replica set payload-pre-processing-e2e-api-a-4a1551-54849fdc55 from 0 to 1 48m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-a-4a1551-54849fdc55 Error creating: pods "payload-pre-processing-e2e-api-a-4a1551-54849fdc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4a1551: serviceaccount "payload-processing-e2e-api-a-4a1551" not found 48m Normal AddedInterface pod/payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc Add eth0 [10.133.0.192/23] from ovn-kubernetes 48m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-a-4a1551-57f4f89d9 Created pod: payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc 48m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-a-4a1551-54849fdc55 Created pod: payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg 48m Normal Pulled pod/payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 48m Normal Started pod/payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg Container started 48m Normal Created pod/payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg Container created 48m Normal Created pod/payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc Container created 48m Normal Pulled pod/payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg Add eth0 [10.133.0.191/23] from ovn-kubernetes 48m Normal Started pod/payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc Container started 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Normal ScalingReplicaSet deployment/payload-processing-e2e-shared-b-w4-013fb2 Scaled up replica set payload-processing-e2e-shared-b-w4-013fb2-5c54856855 from 0 to 1 48m Warning FailedCreate replicaset/payload-processing-e2e-shared-b-w4-013fb2-5c54856855 Error creating: pods "payload-processing-e2e-shared-b-w4-013fb2-5c54856855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-013fb2: serviceaccount "payload-processing-e2e-shared-b-w4-013fb2" not found 48m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-fbb72e-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Normal SuccessfulCreate replicaset/payload-processing-e2e-shared-b-w4-013fb2-5c54856855 Created pod: payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl 48m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-fbb72e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 48m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-shared-b-w4-013fb2 Scaled up replica set payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99 from 0 to 1 48m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99 Created pod: payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 48m Warning FailedCreate replicaset/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99 Error creating: pods "payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-013fb2: serviceaccount "payload-processing-e2e-shared-b-w4-013fb2" not found 48m Normal Started pod/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 Container started 48m Normal Created pod/payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl Container created 48m Normal AddedInterface pod/payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl Add eth0 [10.133.0.194/23] from ovn-kubernetes 48m Normal Pulled pod/payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 Add eth0 [10.133.0.193/23] from ovn-kubernetes 48m Normal Created pod/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 Container created 48m Normal Pulled pod/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 48m Normal Started pod/payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl Container started 48m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-50b188 Scaled up replica set payload-processing-e2e-inf-a-50b188-9b764f45 from 0 to 1 48m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7 Error creating: pods "payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-50b188: serviceaccount "payload-processing-e2e-inf-a-50b188" not found 48m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-50b188-9b764f45 Error creating: pods "payload-processing-e2e-inf-a-50b188-9b764f45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-50b188: serviceaccount "payload-processing-e2e-inf-a-50b188" not found 48m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-50b188 Scaled up replica set payload-pre-processing-e2e-inf-a-50b188-57b95d87b7 from 0 to 1 48m Normal AddedInterface pod/payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w Add eth0 [10.133.0.195/23] from ovn-kubernetes 48m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-50b188-9b764f45 Created pod: payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w 48m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7 Created pod: payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq 48m Normal Pulled pod/payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq Add eth0 [10.134.0.107/23] from ovn-kubernetes 48m Normal Started pod/payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w Container started 48m Normal Created pod/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq Container created 48m Normal Pulled pod/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 48m Normal Started pod/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq Container started 48m Normal Created pod/payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w Container created 48m Normal AddedLabel gateway/e2e-inf-a-d7f4c7 Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d7f4c7 48m Normal AddedInterface pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Add eth0 [10.133.0.196/23] from ovn-kubernetes 48m Normal SuccessfulCreate replicaset/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf Created pod: e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 48m Normal ScalingReplicaSet deployment/e2e-inf-a-d7f4c7-openshift-default Scaled up replica set e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf from 0 to 1 48m Normal AddedLabel gateway/e2e-api-b-1dc70e Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1dc70e 48m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default New size: 7; reason: All metrics below target 48m Normal ScalingReplicaSet deployment/e2e-api-b-1dc70e-openshift-default Scaled up replica set e2e-api-b-1dc70e-openshift-default-769cf49787 from 0 to 1 48m Normal ScalingReplicaSet deployment/e2e-shared-b-w1-3ddec2-openshift-default Scaled up replica set e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 from 4 to 7 48m Normal SuccessfulCreate replicaset/e2e-api-b-1dc70e-openshift-default-769cf49787 Created pod: e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 48m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Created pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj 48m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Created pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn 48m Normal SuccessfulCreate replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Created pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr 47m Normal Created pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Container created 47m Normal Pulled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal Started pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Container started 47m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-kk6pm 47m Normal Created pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Container created 47m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 3; reason: cpu resource utilization (percentage of request) above target 47m Normal AddedInterface pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Add eth0 [10.133.0.197/23] from ovn-kubernetes 47m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Add eth0 [10.133.0.198/23] from ovn-kubernetes 47m Normal Pulled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Add eth0 [10.132.0.112/23] from ovn-kubernetes 47m Normal Started pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Container started 47m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3 47m Normal Started pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Container started 47m Normal Created pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Container created 47m Normal AddedInterface pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Add eth0 [10.134.0.108/23] from ovn-kubernetes 47m Normal Pulled pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Add eth0 [10.134.0.109/23] from ovn-kubernetes 47m Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 47m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-d7f4c7 Scaled up replica set payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55 from 0 to 1 47m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Container started 47m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Container created 47m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.368s (4.368s including waiting). Image size: 185476477 bytes. 47m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-d7f4c7 Scaled up replica set payload-processing-e2e-inf-a-d7f4c7-86584cbcdc from 0 to 1 47m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc Error creating: pods "payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d7f4c7: serviceaccount "payload-processing-e2e-inf-a-d7f4c7" not found 47m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55 Error creating: pods "payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d7f4c7: serviceaccount "payload-processing-e2e-inf-a-d7f4c7" not found 47m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc Created pod: payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz 47m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55 Created pod: payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx 47m Normal Created pod/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz Container created 47m Normal AddedInterface pod/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz Add eth0 [10.134.0.111/23] from ovn-kubernetes 47m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused 47m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx Add eth0 [10.134.0.110/23] from ovn-kubernetes 47m Normal Pulled pod/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 47m Normal Created pod/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx Container created 47m Normal Started pod/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx Container started 47m Normal Pulled pod/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 47m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused... 47m Normal Started pod/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz Container started 47m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused 47m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused... 47m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Readiness probe error: HTTP probe failed with statuscode: 503... 47m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Readiness probe failed: HTTP probe failed with statuscode: 503 47m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused 47m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused... 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default New size: 3; reason: All metrics below target 47m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-1dc70e-759f98d859 Error creating: pods "payload-pre-processing-e2e-api-b-1dc70e-759f98d859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1dc70e: serviceaccount "payload-processing-e2e-api-b-1dc70e" not found 47m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 47m Warning FailedCreate replicaset/payload-processing-e2e-api-b-1dc70e-866854d6d9 Error creating: pods "payload-processing-e2e-api-b-1dc70e-866854d6d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1dc70e: serviceaccount "payload-processing-e2e-api-b-1dc70e" not found 47m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-1dc70e Scaled up replica set payload-pre-processing-e2e-api-b-1dc70e-759f98d859 from 0 to 1 47m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Stopping container istio-proxy 47m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-1dc70e Scaled up replica set payload-processing-e2e-api-b-1dc70e-866854d6d9 from 0 to 1 47m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-1dc70e-759f98d859 Created pod: payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq 47m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-1dc70e-866854d6d9 Created pod: payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 47m Normal Pulled pod/payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 Add eth0 [10.134.0.113/23] from ovn-kubernetes 47m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq Add eth0 [10.134.0.112/23] from ovn-kubernetes 47m Normal Started pod/payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq Container started 47m Normal Created pod/payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq Container created 47m Normal Created pod/payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 Container created 47m Normal Pulled pod/payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 47m Normal Started pod/payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 Container started 47m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Readiness probe error: HTTP probe failed with statuscode: 503... 47m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f7kc6 Readiness probe failed: HTTP probe failed with statuscode: 503 47m Normal Started pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Container started 47m Normal Pulled pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 47m Normal Created pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Container created 47m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv 47m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs 47m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled down replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 5 to 3 47m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled down replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 4 to 3 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default New size: 3; reason: All metrics below target 47m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs Stopping container istio-proxy 47m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Stopping container istio-proxy 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 3; reason: All metrics below target 47m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 47m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 Stopping container istio-proxy 47m Warning Unhealthy pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused 47m Warning ProbeError pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused... 47m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Readiness probe error: HTTP probe failed with statuscode: 503... 47m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Stopping container istio-proxy 47m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p9hwv Readiness probe failed: HTTP probe failed with statuscode: 503 47m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj 47m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default New size: 3; reason: All metrics below target 47m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Readiness probe failed: HTTP probe failed with statuscode: 503 47m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-n79sj Readiness probe error: HTTP probe failed with statuscode: 503... 47m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-d7f4c7-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 47m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-d7f4c7-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 47m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-b34958-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 47m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-b34958-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 46m Normal AddedLabel gateway/e2e-api-b-6b42c9 Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6b42c9 46m Normal ScalingReplicaSet deployment/e2e-api-b-6b42c9-openshift-default Scaled up replica set e2e-api-b-6b42c9-openshift-default-89bbb7987 from 0 to 1 46m Normal SuccessfulCreate replicaset/e2e-api-b-6b42c9-openshift-default-89bbb7987 Created pod: e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt 46m Normal AddedInterface pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Add eth0 [10.132.0.115/23] from ovn-kubernetes 46m Warning ProbeError pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Readiness probe error: Get "http://10.133.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 46m Warning Unhealthy pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Readiness probe failed: Get "http://10.133.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Warning FailedCreate replicaset/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7 Error creating: pods "payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6b42c9: serviceaccount "payload-processing-e2e-api-b-6b42c9" not found 46m Warning FailedCreate replicaset/payload-processing-e2e-api-b-6b42c9-856887dbd5 Error creating: pods "payload-processing-e2e-api-b-6b42c9-856887dbd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6b42c9: serviceaccount "payload-processing-e2e-api-b-6b42c9" not found 46m Normal ScalingReplicaSet deployment/payload-processing-e2e-api-b-6b42c9 Scaled up replica set payload-processing-e2e-api-b-6b42c9-856887dbd5 from 0 to 1 46m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-api-b-6b42c9 Scaled up replica set payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7 from 0 to 1 46m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7 Created pod: payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 46m Normal Started pod/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 Container started 46m Normal SuccessfulCreate replicaset/payload-processing-e2e-api-b-6b42c9-856887dbd5 Created pod: payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g 46m Normal Created pod/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 Container created 46m Normal AddedInterface pod/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 Add eth0 [10.134.0.116/23] from ovn-kubernetes 46m Normal AddedInterface pod/payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g Add eth0 [10.134.0.117/23] from ovn-kubernetes 46m Normal Pulled pod/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 46m Normal Started pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Container started 46m Normal Created pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Container created 46m Normal Pulled pod/payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 46m Normal Created pod/payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g Container created 46m Normal Started pod/payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g Container started 46m Normal Pulled pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Created pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Container created 46m Normal Pulled pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 46m Normal Started pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Container started 46m Warning Unhealthy pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused 46m Warning ProbeError pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused... 46m Warning ProbeError pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Startup probe error: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused... 46m Warning Unhealthy pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Startup probe failed: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused 46m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w4-013fb2-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 46m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w4-013fb2-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 46m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-4a1551-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 46m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-4a1551-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 46m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-6b42c9-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 46m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-6b42c9-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 46m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-shared-b-w4-013fb2-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 46m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-shared-b-w4-013fb2-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Normal AddedLabel gateway/e2e-inf-a-9c76ae Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9c76ae 45m Normal ScalingReplicaSet deployment/e2e-inf-a-9c76ae-openshift-default Scaled up replica set e2e-inf-a-9c76ae-openshift-default-6f5b49f64f from 0 to 1 45m Normal SuccessfulCreate replicaset/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f Created pod: e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj 45m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-a-4a1551-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-a-4a1551-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Normal AddedInterface pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Add eth0 [10.134.0.118/23] from ovn-kubernetes 45m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-9c76ae Scaled up replica set payload-processing-e2e-inf-a-9c76ae-5778b64c47 from 0 to 1 45m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-9c76ae-5778b64c47 Error creating: pods "payload-processing-e2e-inf-a-9c76ae-5778b64c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9c76ae: serviceaccount "payload-processing-e2e-inf-a-9c76ae" not found 45m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-9c76ae Scaled up replica set payload-pre-processing-e2e-inf-a-9c76ae-685979f455 from 0 to 1 45m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-9c76ae-685979f455 Created pod: payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj 45m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-9c76ae-685979f455 Error creating: pods "payload-pre-processing-e2e-inf-a-9c76ae-685979f455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9c76ae: serviceaccount "payload-processing-e2e-inf-a-9c76ae" not found 45m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-9c76ae-5778b64c47 Created pod: payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw 45m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj Add eth0 [10.134.0.119/23] from ovn-kubernetes 45m Normal Created pod/payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw Container created 45m Normal Started pod/payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj Container started 45m Normal Created pod/payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj Container created 45m Normal Pulled pod/payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 45m Normal Started pod/payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw Container started 45m Normal Pulled pod/payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw Add eth0 [10.134.0.120/23] from ovn-kubernetes 45m Warning Unhealthy pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Readiness probe failed: Get "http://10.133.0.196:15021/healthz/ready": read tcp 10.133.0.2:58988->10.133.0.196:15021: read: connection reset by peer 45m Warning ProbeError pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Readiness probe error: Get "http://10.133.0.196:15021/healthz/ready": read tcp 10.133.0.2:58988->10.133.0.196:15021: read: connection reset by peer... 45m Normal Created pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Container created 45m Normal Started pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Container started 45m Normal Pulled pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Created pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Container created 45m Normal Pulled pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Started pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Container started 45m Normal Started pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Container started 45m Normal Pulled pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 45m Normal Created pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Container created 45m Warning Unhealthy pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused 45m Warning ProbeError pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused... 45m Warning Unhealthy pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused 45m Warning Unhealthy pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused 45m Warning ProbeError pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused... 45m Warning ProbeError pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused... 45m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-50b188-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 45m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-50b188-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 45m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Stopping container istio-proxy 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 4; reason: All metrics below target 45m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l 45m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 45m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Stopping container istio-proxy 45m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-ll72l Stopping container istio-proxy 45m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 3; reason: All metrics below target 45m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw 45m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled down replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 6 to 4 45m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled down replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 4 to 3 45m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Readiness probe failed: HTTP probe failed with statuscode: 503 45m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 Readiness probe error: HTTP probe failed with statuscode: 503... 45m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Readiness probe failed: HTTP probe failed with statuscode: 503 45m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6pscw Readiness probe error: HTTP probe failed with statuscode: 503... 45m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-1dc70e-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 45m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-1dc70e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 45m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-50b188-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-50b188-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-1dc70e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-1dc70e-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 45m Normal Killing pod/payload-processing-e2e-api-a-4a1551-57f4f89d9-6f6lc Stopping container payload-processing 45m Normal Killing pod/payload-pre-processing-e2e-api-a-4a1551-54849fdc55-6zbgg Stopping container payload-pre-processing 45m Normal Killing pod/payload-processing-e2e-shared-a-w4-218800-7cfd4b86dc-9zjv9 Stopping container payload-processing 45m Normal Killing pod/payload-pre-processing-e2e-shared-a-w4-218800-dcb8d4f9f-5p2bg Stopping container payload-pre-processing 45m Normal Killing pod/payload-pre-processing-e2e-inf-a-50b188-57b95d87b7-9t9rq Stopping container payload-pre-processing 45m Normal Killing pod/payload-processing-e2e-inf-a-50b188-9b764f45-cqn2w Stopping container payload-processing 45m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-d7f4c7-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 45m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-d7f4c7-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 44m Normal Killing pod/payload-pre-processing-e2e-inf-a-d7f4c7-794784bc55-nf6bx Stopping container payload-pre-processing 44m Normal Killing pod/payload-processing-e2e-inf-a-d7f4c7-86584cbcdc-w5jqz Stopping container payload-processing 44m Normal Killing pod/payload-processing-e2e-api-a-fbb72e-5575659479-vz9nv Stopping container payload-processing 44m Normal Killing pod/payload-pre-processing-e2e-api-a-fbb72e-6d9c658687-q9cjc Stopping container payload-pre-processing 44m Normal Pulled pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 44m Normal Started pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Container started 44m Normal Created pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Container created 44m Warning Unhealthy pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused 44m Warning ProbeError pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused... 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-api-b-6b42c9-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-api-b-6b42c9-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 43m Normal Killing pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Stopping container istio-proxy 43m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-a-w4-218800-openshift-default New size: 2; reason: All metrics below target 43m Normal SuccessfulDelete replicaset/e2e-shared-a-w4-218800-openshift-default-7888c6d55c Deleted pod: e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 43m Normal ScalingReplicaSet deployment/e2e-shared-a-w4-218800-openshift-default Scaled down replica set e2e-shared-a-w4-218800-openshift-default-7888c6d55c from 3 to 2 43m Warning Unhealthy pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Readiness probe failed: HTTP probe failed with statuscode: 503 43m Warning ProbeError pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-dpqs4 Readiness probe error: HTTP probe failed with statuscode: 503... 43m Normal Killing pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf Stopping container istio-proxy 43m Normal Killing pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-6zvtd Stopping container istio-proxy 43m Normal Killing pod/e2e-api-a-4a1551-openshift-default-5866f4745f-rn9dn Stopping container istio-proxy 43m Normal Killing pod/payload-pre-processing-e2e-shared-b-w4-013fb2-78d76d7c99-lfxb9 Stopping container payload-pre-processing 43m Normal Killing pod/payload-processing-e2e-shared-b-w4-013fb2-5c54856855-8fvtl Stopping container payload-processing 43m Normal ScalingReplicaSet deployment/e2e-inf-a-e9aa8e-openshift-default Scaled up replica set e2e-inf-a-e9aa8e-openshift-default-67b95c54df from 0 to 1 43m Normal SuccessfulCreate replicaset/e2e-inf-a-e9aa8e-openshift-default-67b95c54df Created pod: e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp 43m Normal AddedLabel gateway/e2e-inf-a-e9aa8e Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e9aa8e 43m Normal AddedInterface pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Add eth0 [10.132.0.118/23] from ovn-kubernetes 43m Normal Created pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Container created 43m Normal Pulled pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 43m Normal Started pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Container started 43m Normal Killing pod/payload-processing-e2e-api-a-b34958-9786989c7-lcprk Stopping container payload-processing 43m Normal Killing pod/payload-pre-processing-e2e-api-a-b34958-74cf77fb79-rb9rp Stopping container payload-pre-processing 43m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-9c76ae-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-9c76ae-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 43m Normal Killing pod/e2e-inf-a-50b188-openshift-default-768d545959-5ksg6 Stopping container istio-proxy 43m Warning ProbeError pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused... 43m Warning Unhealthy pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused 43m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Stopping container istio-proxy 43m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f 43m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 2; reason: All metrics below target 43m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default Scaled down replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 3 to 2 43m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 43m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Stopping container istio-proxy 43m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Readiness probe failed: HTTP probe failed with statuscode: 503 43m Warning Unhealthy pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Readiness probe failed: HTTP probe failed with statuscode: 503 43m Warning ProbeError pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-j6j7f Readiness probe error: HTTP probe failed with statuscode: 503... 43m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-4ljh8 Readiness probe error: HTTP probe failed with statuscode: 503... 42m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-a-e9aa8e Scaled up replica set payload-processing-e2e-inf-a-e9aa8e-7f96bdc687 from 0 to 1 42m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687 Created pod: payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj 42m Warning FailedCreate replicaset/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687 Error creating: pods "payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e9aa8e: serviceaccount "payload-processing-e2e-inf-a-e9aa8e" not found 42m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-a-e9aa8e Scaled up replica set payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5 from 0 to 1 42m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5 Created pod: payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 42m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5 Error creating: pods "payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e9aa8e: serviceaccount "payload-processing-e2e-inf-a-e9aa8e" not found 42m Normal Started pod/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 Container started 42m Normal Created pod/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 Container created 42m Normal AddedInterface pod/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 Add eth0 [10.134.0.122/23] from ovn-kubernetes 42m Normal AddedInterface pod/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj Add eth0 [10.134.0.123/23] from ovn-kubernetes 42m Normal Pulled pod/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal Started pod/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj Container started 42m Normal Pulled pod/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 42m Normal Created pod/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj Container created 42m Normal Killing pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Stopping container istio-proxy 42m Normal SuccessfulDelete replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Deleted pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 2; reason: All metrics below target 42m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 3 to 2 42m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Stopping container istio-proxy 42m Warning Unhealthy pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Readiness probe failed: HTTP probe failed with statuscode: 503 42m Warning ProbeError pod/e2e-inf-a-d7f4c7-openshift-default-7754f4dcdf-h76j2 Readiness probe error: HTTP probe failed with statuscode: 503... 42m Warning Unhealthy pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Readiness probe failed: HTTP probe failed with statuscode: 503 42m Warning ProbeError pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 Readiness probe error: HTTP probe failed with statuscode: 503... 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-021907-openshift-default (combined from similar events): New size: 2; reason: All metrics below target 42m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Stopping container istio-proxy 42m Normal ScalingReplicaSet deployment/e2e-worker-w5-021907-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w5-021907-openshift-default-dfccf5bf7 from 3 to 2 42m Normal SuccessfulDelete replicaset/e2e-worker-w5-021907-openshift-default-dfccf5bf7 Deleted pod: e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq 42m Warning Unhealthy pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Readiness probe failed: HTTP probe failed with statuscode: 503 42m Warning ProbeError pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-dwvhq Readiness probe error: HTTP probe failed with statuscode: 503... 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 3; reason: All metrics below target 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-9796f1-openshift-default New size: 1; reason: All metrics below target 42m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz Stopping container istio-proxy 42m Normal SuccessfulDelete replicaset/e2e-worker-w3-9796f1-openshift-default-5547cf6495 Deleted pod: e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 42m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default Scaled down replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 4 to 3 42m Normal Killing pod/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd Stopping container payload-pre-processing 42m Normal ScalingReplicaSet deployment/e2e-worker-w3-9796f1-openshift-default Scaled down replica set e2e-worker-w3-9796f1-openshift-default-5547cf6495 from 2 to 1 42m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz 42m Normal Killing pod/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt Stopping container payload-processing 42m Normal Killing pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Stopping container istio-proxy 42m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Readiness probe error: HTTP probe failed with statuscode: 503... 42m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-wqg27 Readiness probe failed: HTTP probe failed with statuscode: 503 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default New size: 6; reason: All metrics below target 42m Normal ScalingReplicaSet deployment/e2e-shared-b-w1-3ddec2-openshift-default Scaled down replica set e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 from 7 to 6 42m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 2; reason: All metrics below target 42m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-kk6pm Stopping container discovery 42m Normal Killing pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj Stopping container istio-proxy 42m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2 42m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-kk6pm 42m Normal SuccessfulDelete replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Deleted pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-qxnxj 42m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-9c76ae-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-9c76ae-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 42m Normal ScalingReplicaSet deployment/e2e-worker-w6-89c0fd-openshift-default Scaled down replica set e2e-worker-w6-89c0fd-openshift-default-6877577c49 from 3 to 2 42m Normal Killing pod/payload-pre-processing-e2e-inf-a-9c76ae-685979f455-kbhsj Stopping container payload-pre-processing 42m Normal Killing pod/payload-processing-e2e-inf-a-9c76ae-5778b64c47-9sqrw Stopping container payload-processing 42m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz Stopping container istio-proxy 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w6-89c0fd-openshift-default New size: 2; reason: All metrics below target 42m Normal SuccessfulDelete replicaset/e2e-worker-w6-89c0fd-openshift-default-6877577c49 Deleted pod: e2e-worker-w6-89c0fd-openshift-default-6877577c49-nrspz 42m Normal Killing pod/payload-processing-e2e-shared-a-w1-2ace1d-77f8c57d55-zd8ns Stopping container payload-processing 42m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w6-89c0fd-655b9c447f-zvkkd Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 42m Normal Killing pod/payload-pre-processing-e2e-shared-a-w1-2ace1d-5456899699-jbtk8 Stopping container payload-pre-processing 42m Warning Unhealthy pod/payload-processing-e2e-worker-w6-89c0fd-78cdfddb47-f58wt Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 42m Normal SuccessfulDelete replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Deleted pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l 42m Normal ScalingReplicaSet deployment/e2e-shared-b-w1-3ddec2-openshift-default Scaled down replica set e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 from 6 to 3 42m Normal SuccessfulRescale horizontalpodautoscaler/e2e-shared-b-w1-3ddec2-openshift-default New size: 3; reason: All metrics below target 42m Normal Killing pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Stopping container istio-proxy 42m Normal Killing pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn Stopping container istio-proxy 42m Normal Killing pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Stopping container istio-proxy 42m Normal SuccessfulDelete replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Deleted pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn 42m Normal SuccessfulDelete replicaset/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5 Deleted pod: e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg 42m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Readiness probe error: HTTP probe failed with statuscode: 503... 42m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Readiness probe error: HTTP probe failed with statuscode: 503... 42m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-hrq9l Readiness probe failed: HTTP probe failed with statuscode: 503 42m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg Readiness probe failed: HTTP probe failed with statuscode: 503 42m Normal Killing pod/e2e-inf-a-9c76ae-openshift-default-6f5b49f64f-k4fcj Stopping container istio-proxy 42m Normal Killing pod/e2e-shared-a-w1-2ace1d-openshift-default-78d5c9bf57-dfwkt Stopping container istio-proxy 42m Normal Killing pod/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g Stopping container payload-processing 42m Normal Killing pod/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv Stopping container payload-pre-processing 41m Normal Killing pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc Stopping container istio-proxy 41m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w3-9796f1-fc64697f-x2phv Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 41m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Stopping container istio-proxy 41m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 10 to 5 41m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-fzjdh Stopping container istio-proxy 41m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-qjkt6 41m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Stopping container istio-proxy 41m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 5; reason: All metrics below target 41m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-fzjdh 41m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Stopping container istio-proxy 41m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-pg8wh 41m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Stopping container istio-proxy 41m Warning Unhealthy pod/payload-processing-e2e-worker-w3-9796f1-6799974f65-tjn5g Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 41m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Readiness probe error: HTTP probe failed with statuscode: 503... 41m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Readiness probe error: HTTP probe failed with statuscode: 503... 41m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Readiness probe error: HTTP probe failed with statuscode: 503... 41m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-qjkt6 Readiness probe failed: HTTP probe failed with statuscode: 503 41m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-lbxq2 Readiness probe failed: HTTP probe failed with statuscode: 503 41m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-pg8wh Readiness probe failed: HTTP probe failed with statuscode: 503 41m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused... 41m Normal Killing pod/e2e-shared-b-w4-013fb2-openshift-default-bc7cfdb5c-xcjdm Stopping container istio-proxy 41m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-bc7r2 Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused 41m Normal Killing pod/payload-processing-e2e-shared-b-w1-3ddec2-56c75946c9-rndgt Stopping container payload-processing 41m Normal AddedLabel gateway/e2e-mt-75c2acf6 Added label istio.io/rev=openshift-gateway to gateway e2e-mt-75c2acf6 41m Normal Killing pod/payload-pre-processing-e2e-shared-b-w1-3ddec2-7446bd4979-j7h4q Stopping container payload-pre-processing 41m Normal ScalingReplicaSet deployment/e2e-mt-75c2acf6-openshift-default Scaled up replica set e2e-mt-75c2acf6-openshift-default-74d4bc544f from 0 to 1 41m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Add eth0 [10.133.0.216/23] from ovn-kubernetes 41m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c 41m Normal Killing pod/payload-pre-processing-e2e-api-b-1dc70e-759f98d859-jlbfq Stopping container payload-pre-processing 41m Normal Killing pod/payload-processing-e2e-api-b-1dc70e-866854d6d9-vf4f7 Stopping container payload-processing 41m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-75c2acf6 Scaled up replica set payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75 from 0 to 1 41m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-75c2acf6 Scaled up replica set payload-processing-e2e-mt-75c2acf6-695b87cb85 from 0 to 1 41m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75 Error creating: pods "payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-75c2acf6: serviceaccount "payload-processing-e2e-mt-75c2acf6" not found 41m Warning FailedCreate replicaset/payload-processing-e2e-mt-75c2acf6-695b87cb85 Error creating: pods "payload-processing-e2e-mt-75c2acf6-695b87cb85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-75c2acf6: serviceaccount "payload-processing-e2e-mt-75c2acf6" not found 41m Normal Pulled pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 41m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-75c2acf6-695b87cb85 Created pod: payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh 41m Normal AddedInterface pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl Add eth0 [10.133.0.217/23] from ovn-kubernetes 41m Normal Created pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl Container created 41m Normal Started pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl Container started 41m Normal AddedInterface pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh Add eth0 [10.133.0.218/23] from ovn-kubernetes 41m Normal Pulled pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 41m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75 Created pod: payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl 41m Normal Created pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh Container created 41m Normal Started pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh Container started 41m Normal Started pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Container started 41m Normal Pulled pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 41m Normal Created pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Container created 40m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Stopping container istio-proxy 40m Normal Killing pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz Stopping container istio-proxy 40m Normal Killing pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Stopping container istio-proxy 40m Normal Killing pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-csfvr Stopping container istio-proxy 40m Normal Killing pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Stopping container istio-proxy 40m Warning ProbeError pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused 40m Warning Unhealthy pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused 40m Warning ProbeError pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-j7nbd Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused... 40m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Readiness probe failed: HTTP probe failed with statuscode: 503 40m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-lclgj Readiness probe error: HTTP probe failed with statuscode: 503... 40m Warning Unhealthy pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Readiness probe failed: Get "http://10.133.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 40m Warning ProbeError pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-blkpz Readiness probe error: Get "http://10.133.0.188:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 40m Normal AddedLabel gateway/e2e-inf-b-dbe6da Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-dbe6da 40m Normal ScalingReplicaSet deployment/e2e-inf-b-dbe6da-openshift-default Scaled up replica set e2e-inf-b-dbe6da-openshift-default-6d448cf4fc from 0 to 1 40m Normal SuccessfulCreate replicaset/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc Created pod: e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh 40m Normal AddedInterface pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Add eth0 [10.133.0.222/23] from ovn-kubernetes 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-e9aa8e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-e9aa8e-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 40m Normal Killing pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Stopping container istio-proxy 40m Warning Unhealthy pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Readiness probe failed: HTTP probe failed with statuscode: 503 40m Warning ProbeError pod/e2e-api-a-b34958-openshift-default-559d74f555-htq4p Readiness probe error: HTTP probe failed with statuscode: 503... 40m Normal Killing pod/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs Stopping container payload-processing 40m Normal Killing pod/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d Stopping container payload-pre-processing 40m Normal ScalingReplicaSet deployment/e2e-worker-w1-e4dadd-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w1-e4dadd-openshift-default-555c77774c from 3 to 2 40m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Readiness probe error: HTTP probe failed with statuscode: 503... 40m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Readiness probe failed: HTTP probe failed with statuscode: 503 40m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-e4dadd-openshift-default New size: 2; reason: All metrics below target 40m Normal SuccessfulDelete replicaset/e2e-worker-w1-e4dadd-openshift-default-555c77774c Deleted pod: e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz 40m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-k5wlz Stopping container istio-proxy 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-a-e9aa8e-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Warning FailedCreate replicaset/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59 Error creating: pods "payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-dbe6da: serviceaccount "payload-processing-e2e-inf-b-dbe6da" not found 40m Normal ScalingReplicaSet deployment/payload-processing-e2e-inf-b-dbe6da Scaled up replica set payload-processing-e2e-inf-b-dbe6da-db659d675 from 0 to 1 40m Normal Killing pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Stopping container istio-proxy 40m Warning FailedCreate replicaset/payload-processing-e2e-inf-b-dbe6da-db659d675 Error creating: pods "payload-processing-e2e-inf-b-dbe6da-db659d675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-dbe6da: serviceaccount "payload-processing-e2e-inf-b-dbe6da" not found 40m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-inf-b-dbe6da Scaled up replica set payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59 from 0 to 1 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-a-e9aa8e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Normal AddedInterface pod/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 Add eth0 [10.133.0.224/23] from ovn-kubernetes 40m Normal SuccessfulCreate replicaset/payload-processing-e2e-inf-b-dbe6da-db659d675 Created pod: payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl 40m Normal AddedInterface pod/payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl Add eth0 [10.134.0.125/23] from ovn-kubernetes 40m Normal Started pod/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 Container started 40m Normal Created pod/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 Container created 40m Normal Pulled pod/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59 Created pod: payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 40m Normal Pulled pod/payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 40m Normal Created pod/payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl Container created 40m Normal Started pod/payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl Container started 40m Warning Unhealthy pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Readiness probe failed: HTTP probe failed with statuscode: 503 40m Warning ProbeError pod/e2e-api-b-1dc70e-openshift-default-769cf49787-pvf48 Readiness probe error: HTTP probe failed with statuscode: 503... 40m Normal Killing pod/payload-processing-e2e-api-b-6b42c9-856887dbd5-mrd6g Stopping container payload-processing 40m Normal Killing pod/payload-pre-processing-e2e-api-b-6b42c9-5b9f87fdd7-jg7x5 Stopping container payload-pre-processing 40m Warning Unhealthy pod/payload-processing-e2e-worker-w1-e4dadd-549899bd9c-9gqcs Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 40m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w1-e4dadd-5c9548cc55-kmp5d Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 40m Normal Killing pod/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd Stopping container payload-processing 40m Normal Killing pod/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 Stopping container payload-pre-processing 40m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 40m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-75c2acf6-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-75c2acf6-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 40m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Container started 40m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Container created 40m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Startup probe failed: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused 40m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Startup probe error: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused... 40m Normal Killing pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Stopping container istio-proxy 39m Warning Unhealthy pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Readiness probe failed: HTTP probe failed with statuscode: 503 39m Warning ProbeError pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-fsqnp Readiness probe error: HTTP probe failed with statuscode: 503... 39m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w5-021907-5f85877d59-wfs94 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 39m Warning Unhealthy pod/payload-processing-e2e-worker-w5-021907-6fdc9848f9-lklrd Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 39m Normal Killing pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt Stopping container istio-proxy 39m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-mt-75c2acf6-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-mt-75c2acf6-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 39m Normal Killing pod/payload-processing-e2e-shared-a-w0-3b21b4-667967d7d5-24pkx Stopping container payload-processing 39m Normal Killing pod/payload-pre-processing-e2e-shared-a-w0-3b21b4-df55bf4b7-8xxf6 Stopping container payload-pre-processing 39m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw Stopping container istio-proxy 39m Normal Killing pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-g8wtm Stopping container istio-proxy 39m Normal Started pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Container started 39m Normal Created pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Container created 39m Normal Pulled pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 39m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Stopping container istio-proxy 39m Normal Killing pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd Stopping container istio-proxy 39m Warning Unhealthy pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Readiness probe failed: HTTP probe failed with statuscode: 503 39m Warning ProbeError pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-tc7zr Readiness probe error: HTTP probe failed with statuscode: 503... 39m Normal Killing pod/e2e-shared-a-w0-3b21b4-openshift-default-9cc79755f-s4frx Stopping container istio-proxy 39m Warning ProbeError pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused... 39m Warning Unhealthy pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-dbe6da-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-dbe6da-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 38m Normal Killing pod/payload-pre-processing-e2e-shared-b-w0-d6a241-96b78b6c9-q8frr Stopping container payload-pre-processing 38m Normal Killing pod/payload-processing-e2e-shared-b-w0-d6a241-867b98b47-f68xj Stopping container payload-processing 38m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-inf-b-dbe6da-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-inf-b-dbe6da-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 38m Normal Killing pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk Stopping container istio-proxy 37m Normal Killing pod/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb Stopping container payload-pre-processing 37m Normal Killing pod/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt Stopping container payload-processing 37m Warning Unhealthy pod/payload-processing-e2e-worker-w0-1b5b5f-6766bd67c-mn6jt Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 37m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w0-1b5b5f-5bd94f6ddc-8g4nb Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 37m Normal Killing pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh Stopping container payload-processing 37m Normal Killing pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl Stopping container payload-pre-processing 37m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-1b5b5f-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 37m Normal ScalingReplicaSet deployment/e2e-worker-w0-1b5b5f-openshift-default Scaled up replica set e2e-worker-w0-1b5b5f-openshift-default-59bd77464c from 2 to 4 37m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 37m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s Add eth0 [10.134.0.130/23] from ovn-kubernetes 37m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s Container started 37m Normal Started pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn Container started 37m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s Container created 37m Normal Created pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn Container created 37m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s 37m Normal AddedInterface pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn Add eth0 [10.133.0.237/23] from ovn-kubernetes 37m Normal Pulled pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 37m Normal SuccessfulCreate replicaset/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c Created pod: e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn 37m Warning FailedToRetrieveImagePullSecret pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s Unable to retrieve some image pull secrets (e2e-worker-w0-1b5b5f-openshift-default-dockercfg-kzsbh); attempting to pull the image may not succeed. 37m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-vvnjq Stopping container istio-proxy 37m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x Stopping container istio-proxy 37m Warning FailedToRetrieveImagePullSecret pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn Unable to retrieve some image pull secrets (e2e-worker-w0-1b5b5f-openshift-default-dockercfg-kzsbh); attempting to pull the image may not succeed. 37m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-wnp4s Stopping container istio-proxy 37m Normal Killing pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-rhshn Stopping container istio-proxy 36m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1 36m Normal Killing pod/istiod-openshift-gateway-7ddd9cfdc8-v6qfg Stopping container discovery 36m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7ddd9cfdc8 Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-v6qfg 36m Normal SuccessfulRescale horizontalpodautoscaler/istiod-openshift-gateway New size: 1; reason: All metrics below target 36m Warning Unhealthy pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-hzwkl Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 36m Warning Unhealthy pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-wwskh Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 36m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Stopping container istio-proxy 36m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-hdc94 36m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 5 to 3 36m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 3; reason: All metrics below target 36m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Stopping container istio-proxy 36m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Readiness probe failed: HTTP probe failed with statuscode: 503 36m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp Readiness probe error: HTTP probe failed with statuscode: 503... 36m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Readiness probe failed: HTTP probe failed with statuscode: 503 36m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 Readiness probe error: HTTP probe failed with statuscode: 503... 36m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 Stopping container istio-proxy 36m Normal ScalingReplicaSet deployment/e2e-worker-w4-07fa8e-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w4-07fa8e-openshift-default-756d98f699 from 2 to 1 36m Normal SuccessfulDelete replicaset/e2e-worker-w4-07fa8e-openshift-default-756d98f699 Deleted pod: e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 36m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-07fa8e-openshift-default New size: 1; reason: All metrics below target 35m Normal ScalingReplicaSet deployment/payload-processing-e2e-mt-75c2acf6 Scaled up replica set payload-processing-e2e-mt-75c2acf6-695b87cb85 from 0 to 1 35m Normal SuccessfulCreate replicaset/payload-processing-e2e-mt-75c2acf6-695b87cb85 Created pod: payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h 35m Warning FailedCreate replicaset/payload-processing-e2e-mt-75c2acf6-695b87cb85 Error creating: pods "payload-processing-e2e-mt-75c2acf6-695b87cb85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-75c2acf6: serviceaccount "payload-processing-e2e-mt-75c2acf6" not found 35m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-mt-75c2acf6 Scaled up replica set payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75 from 0 to 1 35m Warning FailedCreate replicaset/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75 Error creating: pods "payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-75c2acf6: serviceaccount "payload-processing-e2e-mt-75c2acf6" not found 35m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75 Created pod: payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh 35m Normal AddedInterface pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h Add eth0 [10.134.0.133/23] from ovn-kubernetes 35m Normal Started pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h Container started 35m Normal Created pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h Container created 35m Normal Pulled pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal Started pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh Container started 35m Normal Created pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh Container created 35m Normal Pulled pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh Add eth0 [10.134.0.132/23] from ovn-kubernetes 35m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Add eth0 [10.134.0.135/23] from ovn-kubernetes 35m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Add eth0 [10.132.0.122/23] from ovn-kubernetes 35m Normal ScalingReplicaSet deployment/e2e-mt-75c2acf6-openshift-default Scaled up replica set e2e-mt-75c2acf6-openshift-default-74d4bc544f from 1 to 4 35m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Add eth0 [10.134.0.136/23] from ovn-kubernetes 35m Normal SuccessfulRescale horizontalpodautoscaler/e2e-mt-75c2acf6-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 35m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd 35m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c 35m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z 35m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Container created 35m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Container started 35m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Container started 35m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Container created 35m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Container started 35m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Container created 35m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 35m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Startup probe error: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused... 35m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Startup probe failed: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused 35m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused 35m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused... 35m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused 35m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused... 34m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 34m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h 34m Normal SuccessfulRescale horizontalpodautoscaler/e2e-mt-75c2acf6-openshift-default New size: 8; reason: 34m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt 34m Normal ScalingReplicaSet deployment/e2e-mt-75c2acf6-openshift-default Scaled up replica set e2e-mt-75c2acf6-openshift-default-74d4bc544f from 4 to 8 34m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx 34m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Add eth0 [10.133.0.243/23] from ovn-kubernetes 34m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Add eth0 [10.132.0.123/23] from ovn-kubernetes 34m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Add eth0 [10.134.0.137/23] from ovn-kubernetes 34m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Container started 34m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Container started 34m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Container created 34m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Container created 34m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Container created 34m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Container created 34m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Add eth0 [10.133.0.244/23] from ovn-kubernetes 34m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Container started 34m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Container started 34m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused 34m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Startup probe failed: Get "http://10.133.0.243:15021/healthz/ready": dial tcp 10.133.0.243:15021: connect: connection refused 34m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Startup probe failed: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused 34m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Startup probe error: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Startup probe failed: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused 34m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Startup probe error: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused... 34m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Startup probe error: Get "http://10.133.0.243:15021/healthz/ready": dial tcp 10.133.0.243:15021: connect: connection refused... 34m Normal ScalingReplicaSet deployment/e2e-worker-w2-446ca2-openshift-default (combined from similar events): Scaled down replica set e2e-worker-w2-446ca2-openshift-default-f46fcc757 from 2 to 1 34m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Stopping container istio-proxy 34m Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-446ca2-openshift-default (combined from similar events): New size: 1; reason: All metrics below target 34m Normal SuccessfulDelete replicaset/e2e-worker-w2-446ca2-openshift-default-f46fcc757 Deleted pod: e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 34m Warning ProbeError pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-99846 Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused 34m Normal ScalingReplicaSet deployment/e2e-mt-75c2acf6-openshift-default Scaled up replica set e2e-mt-75c2acf6-openshift-default-74d4bc544f from 8 to 10 34m Normal SuccessfulRescale horizontalpodautoscaler/e2e-mt-75c2acf6-openshift-default New size: 10; reason: 34m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 34m Normal SuccessfulCreate replicaset/e2e-mt-75c2acf6-openshift-default-74d4bc544f (combined from similar events): Created pod: e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g 34m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Container created 34m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Add eth0 [10.134.0.139/23] from ovn-kubernetes 34m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Container started 34m Normal Created pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Container created 34m Normal AddedInterface pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Add eth0 [10.132.0.124/23] from ovn-kubernetes 34m Normal Pulled pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 34m Normal Started pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Container started 34m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Startup probe failed: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused 34m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Startup probe error: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused... 34m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused 34m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused... 34m Normal Killing pod/payload-pre-processing-e2e-mt-75c2acf6-7754c5cf75-66nkh Stopping container payload-pre-processing 34m Normal Killing pod/payload-processing-e2e-mt-75c2acf6-695b87cb85-mxv8h Stopping container payload-processing 34m Normal Killing pod/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 Stopping container payload-pre-processing 34m Normal Killing pod/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj Stopping container payload-processing 34m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Stopping container istio-proxy 34m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 2; reason: All metrics below target 34m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 3 to 2 34m Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-hqlmj 34m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Readiness probe failed: HTTP probe failed with statuscode: 503 34m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-hqlmj Readiness probe error: HTTP probe failed with statuscode: 503... 33m Warning Unhealthy pod/payload-processing-e2e-inf-a-e9aa8e-7f96bdc687-sdcxj Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 33m Warning Unhealthy pod/payload-pre-processing-e2e-inf-a-e9aa8e-56dbb478f5-qszc2 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 33m Normal Killing pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp Stopping container istio-proxy 33m Normal Killing pod/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 Stopping container payload-pre-processing 33m Normal Killing pod/payload-processing-e2e-inf-b-dbe6da-db659d675-4ddhl Stopping container payload-processing 33m Warning Unhealthy pod/payload-pre-processing-e2e-inf-b-dbe6da-58db7f7b59-chhr8 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 32m Normal Killing pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Stopping container istio-proxy 32m Warning ProbeError pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Readiness probe error: HTTP probe failed with statuscode: 503... 32m Warning Unhealthy pod/e2e-inf-b-dbe6da-openshift-default-6d448cf4fc-6zrwh Readiness probe failed: HTTP probe failed with statuscode: 503 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-r2p5g Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-h8gdt Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-dfv5h Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-w72x2 Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-g2r7z Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-tlbwd Stopping container istio-proxy 32m Normal Killing pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c Stopping container istio-proxy 32m Warning ProbeError pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Readiness probe error: HTTP probe failed with statuscode: 503... 32m Warning Unhealthy pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-99n7c Readiness probe failed: HTTP probe failed with statuscode: 503 32m Normal Killing pod/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 Stopping container payload-processing 32m Normal Killing pod/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 Stopping container payload-pre-processing 32m Normal Killing pod/payload-processing-e2e-worker-w2-446ca2-5db4694b8c-2t9sc Stopping container payload-processing 32m Normal Killing pod/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq Stopping container payload-pre-processing 32m Warning Unhealthy pod/payload-processing-e2e-worker-w4-07fa8e-c95f9979c-h5hf9 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 32m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w4-07fa8e-769597d555-kl984 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 32m Warning Unhealthy pod/payload-pre-processing-e2e-worker-w2-446ca2-5f4d7f56f5-znhbq Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 32m Normal Killing pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-8d9g5 Stopping container istio-proxy 32m Normal Killing pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-d5prc Stopping container istio-proxy 31m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 31m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 31m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 2 to 1 31m Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 Stopping container istio-proxy 31m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 31m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Add eth0 [10.132.0.125/23] from ovn-kubernetes 31m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Add eth0 [10.134.0.142/23] from ovn-kubernetes 31m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 1 to 4 31m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Container started 31m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Container created 31m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Container created 31m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Container started 31m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Container started 31m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Add eth0 [10.134.0.141/23] from ovn-kubernetes 31m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Container created 31m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 31m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused... 31m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused 31m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused 31m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused... 31m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused 31m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused... 29m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Add eth0 [10.133.1.1/23] from ovn-kubernetes 29m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-7f694df8bc Created pod: maas-default-gateway-openshift-default-7f694df8bc-f7ssq 29m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 8; reason: cpu resource utilization (percentage of request) above target 29m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 4 to 8 29m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Add eth0 [10.134.0.144/23] from ovn-kubernetes 29m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Add eth0 [10.132.0.126/23] from ovn-kubernetes 29m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Container created 29m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Container started 29m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Container created 29m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Container started 29m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Container started 29m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Container created 29m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Container started 29m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Container created 29m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Add eth0 [10.133.1.0/23] from ovn-kubernetes 29m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Startup probe error: Get "http://10.133.1.0:15021/healthz/ready": dial tcp 10.133.1.0:15021: connect: connection refused... 29m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused 29m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Startup probe error: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused... 29m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Startup probe failed: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused 29m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused... 29m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused 29m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Startup probe failed: Get "http://10.133.1.0:15021/healthz/ready": dial tcp 10.133.1.0:15021: connect: connection refused 29m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused... 29m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-7f694df8bc from 8 to 10 29m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 10; reason: 29m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Add eth0 [10.132.0.127/23] from ovn-kubernetes 29m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Container created 29m Normal AddedInterface pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Add eth0 [10.134.0.145/23] from ovn-kubernetes 29m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Container started 29m Normal Started pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Container started 29m Normal Created pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Container created 29m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Normal Pulled pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 29m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused... 29m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Startup probe error: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused... 29m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Startup probe failed: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused 29m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused 28m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Readiness probe failed: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 28m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Readiness probe error: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 26m Warning Unhealthy pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 26m Warning ProbeError pod/maas-default-gateway-openshift-default-7f694df8bc-nfl6x Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 23m Normal SuccessfulCreate replicaset/e2e-worker-single-main-c3e01b-openshift-default-6984d596f Created pod: e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 23m Normal AddedLabel gateway/e2e-worker-single-main-c3e01b Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-c3e01b 23m Normal ScalingReplicaSet deployment/e2e-worker-single-main-c3e01b-openshift-default Scaled up replica set e2e-worker-single-main-c3e01b-openshift-default-6984d596f from 0 to 1 23m Normal AddedInterface pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Add eth0 [10.134.0.146/23] from ovn-kubernetes 23m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74c Created pod: payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr 23m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-single-main-c3e01b-6775ff8f87 Error creating: pods "payload-pre-processing-e2e-worker-single-main-c3e01b-6775ff8f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c3e01b: serviceaccount "payload-processing-e2e-worker-single-main-c3e01b" not found 23m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-single-main-c3e01b Scaled up replica set payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74c from 0 to 1 23m Warning FailedCreate replicaset/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74c Error creating: pods "payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c3e01b: serviceaccount "payload-processing-e2e-worker-single-main-c3e01b" not found 23m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-single-main-c3e01b Scaled up replica set payload-pre-processing-e2e-worker-single-main-c3e01b-6775ff8f87 from 0 to 1 23m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-single-main-c3e01b-6775ff8f87 Created pod: payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt 23m Normal Started pod/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt Container started 23m Normal AddedInterface pod/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr Add eth0 [10.134.0.147/23] from ovn-kubernetes 23m Normal Created pod/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt Container created 23m Normal Pulled pod/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 23m Normal Started pod/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr Container started 23m Normal AddedInterface pod/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt Add eth0 [10.134.0.148/23] from ovn-kubernetes 23m Normal Created pod/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr Container created 23m Normal Pulled pod/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 23m Normal Pulled pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 23m Normal Started pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Container started 23m Normal Created pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Container created 23m Warning ProbeError pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused... 23m Warning Unhealthy pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused 22m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-c3e01b-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 22m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-c3e01b-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 21m Normal Killing pod/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr Stopping container payload-processing 21m Normal Killing pod/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt Stopping container payload-pre-processing 21m Normal Killing pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Stopping container istio-proxy 21m Warning Unhealthy pod/payload-pre-processing-e2e-worker-single-main-c3e01b-6775fd25nt Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 21m Warning Unhealthy pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Readiness probe failed: HTTP probe failed with statuscode: 503 21m Warning Unhealthy pod/payload-processing-e2e-worker-single-main-c3e01b-7ffd4bf74lbkmr Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 21m Warning ProbeError pod/e2e-worker-single-main-c3e01b-openshift-default-6984d596f-xjsl6 Readiness probe error: HTTP probe failed with statuscode: 503... 18m Normal SuccessfulCreate replicaset/e2e-worker-single-main-c60cfe-openshift-default-6974d657c Created pod: e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb 18m Normal ScalingReplicaSet deployment/e2e-worker-single-main-c60cfe-openshift-default Scaled up replica set e2e-worker-single-main-c60cfe-openshift-default-6974d657c from 0 to 1 18m Normal AddedLabel gateway/e2e-worker-single-main-c60cfe Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-c60cfe 18m Normal AddedInterface pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Add eth0 [10.134.0.152/23] from ovn-kubernetes 17m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-single-main-c60cfe Scaled up replica set payload-processing-e2e-worker-single-main-c60cfe-997d987d9 from 0 to 1 17m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd855 Error creating: pods "payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c60cfe: serviceaccount "payload-processing-e2e-worker-single-main-c60cfe" not found 17m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-single-main-c60cfe Scaled up replica set payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd855 from 0 to 1 17m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-single-main-c60cfe-997d987d9 Created pod: payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x 17m Warning FailedCreate replicaset/payload-processing-e2e-worker-single-main-c60cfe-997d987d9 Error creating: pods "payload-processing-e2e-worker-single-main-c60cfe-997d987d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-c60cfe: serviceaccount "payload-processing-e2e-worker-single-main-c60cfe" not found 17m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd855 Created pod: payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z 17m Normal Pulled pod/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 17m Normal AddedInterface pod/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z Add eth0 [10.134.0.153/23] from ovn-kubernetes 17m Normal Created pod/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z Container created 17m Normal Started pod/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x Container started 17m Normal Created pod/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x Container created 17m Normal Pulled pod/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 17m Normal AddedInterface pod/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x Add eth0 [10.133.1.21/23] from ovn-kubernetes 17m Normal Started pod/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z Container started 17m Normal Started pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Container started 17m Normal Created pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Container created 17m Normal Pulled pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 17m Warning Unhealthy pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Startup probe failed: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused 17m Warning ProbeError pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Startup probe error: Get "http://10.134.0.152:15021/healthz/ready": dial tcp 10.134.0.152:15021: connect: connection refused... 17m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-c60cfe-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 17m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-c60cfe-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 16m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-single-main-c60cfe-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 16m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-single-main-c60cfe-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 15m Normal Killing pod/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z Stopping container payload-pre-processing 15m Normal Killing pod/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x Stopping container payload-processing 15m Normal Killing pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Stopping container istio-proxy 15m Warning Unhealthy pod/payload-pre-processing-e2e-worker-single-main-c60cfe-d867dd4s2z Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 15m Warning Unhealthy pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Readiness probe failed: HTTP probe failed with statuscode: 503 15m Warning ProbeError pod/e2e-worker-single-main-c60cfe-openshift-default-6974d657c-7hlfb Readiness probe error: HTTP probe failed with statuscode: 503... 15m Warning Unhealthy pod/payload-processing-e2e-worker-single-main-c60cfe-997d987d9gd65x Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 12m Normal AddedLabel gateway/e2e-ait-daf0fd7e Added label istio.io/rev=openshift-gateway to gateway e2e-ait-daf0fd7e 12m Normal ScalingReplicaSet deployment/e2e-ait-daf0fd7e-openshift-default Scaled up replica set e2e-ait-daf0fd7e-openshift-default-79b49d967 from 0 to 1 12m Normal AddedInterface pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Add eth0 [10.134.0.159/23] from ovn-kubernetes 12m Normal SuccessfulCreate replicaset/e2e-ait-daf0fd7e-openshift-default-79b49d967 Created pod: e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr 12m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-ait-daf0fd7e Scaled up replica set payload-pre-processing-e2e-ait-daf0fd7e-fc995d59 from 0 to 1 12m Warning FailedCreate replicaset/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59 Error creating: pods "payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-daf0fd7e: serviceaccount "payload-processing-e2e-ait-daf0fd7e" not found 12m Warning FailedCreate replicaset/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5 Error creating: pods "payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-daf0fd7e: serviceaccount "payload-processing-e2e-ait-daf0fd7e" not found 12m Normal SuccessfulCreate replicaset/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5 Created pod: payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 12m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59 Created pod: payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 12m Normal ScalingReplicaSet deployment/payload-processing-e2e-ait-daf0fd7e Scaled up replica set payload-processing-e2e-ait-daf0fd7e-5847b5cfb5 from 0 to 1 12m Normal Started pod/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 Container started 12m Normal AddedInterface pod/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 Add eth0 [10.134.0.160/23] from ovn-kubernetes 12m Normal Started pod/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 Container started 12m Normal Created pod/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 Container created 12m Normal Pulled pod/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 12m Normal AddedInterface pod/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 Add eth0 [10.134.0.161/23] from ovn-kubernetes 12m Normal Created pod/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 Container created 12m Normal Pulled pod/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 11m Warning ProbeError pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Readiness probe error: Get "http://10.134.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 11m Warning Unhealthy pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Readiness probe failed: Get "http://10.134.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 11m Normal Started pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Container started 11m Normal Created pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Container created 11m Normal Pulled pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 11m Warning ProbeError pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused... 11m Warning Unhealthy pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused 11m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-daf0fd7e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 11m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-daf0fd7e-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 11m Normal Killing pod/payload-processing-e2e-ait-daf0fd7e-5847b5cfb5-kdjv8 Stopping container payload-processing 11m Normal Killing pod/payload-pre-processing-e2e-ait-daf0fd7e-fc995d59-pc545 Stopping container payload-pre-processing 11m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-ait-daf0fd7e-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-ait-daf0fd7e-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 11m Normal Killing pod/e2e-ait-daf0fd7e-openshift-default-79b49d967-bl4pr Stopping container istio-proxy 10m Normal ScalingReplicaSet deployment/e2e-authcfg-http-161f7a-openshift-default Scaled up replica set e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797 from 0 to 1 10m Normal SuccessfulCreate replicaset/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797 Created pod: e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm 10m Normal AddedLabel gateway/e2e-authcfg-http-161f7a Added label istio.io/rev=openshift-gateway to gateway e2e-authcfg-http-161f7a 10m Normal AddedInterface pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Add eth0 [10.134.0.162/23] from ovn-kubernetes 10m Normal ScalingReplicaSet deployment/payload-processing-e2e-authcfg-http-161f7a Scaled up replica set payload-processing-e2e-authcfg-http-161f7a-5674f96d7f from 0 to 1 10m Normal SuccessfulCreate replicaset/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f Created pod: payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm 10m Warning FailedCreate replicaset/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f Error creating: pods "payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-authcfg-http-161f7a: serviceaccount "payload-processing-e2e-authcfg-http-161f7a" not found 10m Warning FailedCreate replicaset/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff Error creating: pods "payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-authcfg-http-161f7a: serviceaccount "payload-processing-e2e-authcfg-http-161f7a" not found 10m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff Created pod: payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l 10m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-authcfg-http-161f7a Scaled up replica set payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff from 0 to 1 10m Normal AddedInterface pod/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l Add eth0 [10.134.0.163/23] from ovn-kubernetes 10m Normal Pulled pod/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 10m Normal Pulled pod/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 10m Normal Created pod/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l Container created 10m Normal AddedInterface pod/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm Add eth0 [10.134.0.164/23] from ovn-kubernetes 10m Normal Started pod/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l Container started 10m Normal Started pod/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm Container started 10m Normal Created pod/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm Container created 10m Normal Created pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Container created 10m Normal Started pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Container started 10m Normal Pulled pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 10m Warning ProbeError pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused... 10m Warning Unhealthy pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused 10m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-authcfg-http-161f7a-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 10m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-authcfg-http-161f7a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m56s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-authcfg-http-161f7a-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m56s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-authcfg-http-161f7a-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 8m34s Normal Killing pod/payload-processing-e2e-authcfg-http-161f7a-5674f96d7f-rv7dm Stopping container payload-processing 8m34s Normal Killing pod/payload-pre-processing-e2e-authcfg-http-161f7a-57b7db64ff-fcc9l Stopping container payload-pre-processing 8m17s Normal Killing pod/e2e-authcfg-http-161f7a-openshift-default-5f8b8f6797-ph5qm Stopping container istio-proxy 107s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 9; reason: All metrics below target 107s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-zqcqx Stopping container istio-proxy 107s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-zqcqx 107s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 10 to 9 92s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-qxjl4 Stopping container istio-proxy 92s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-dqh7x 92s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-mblkw Stopping container istio-proxy 92s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-66hx9 Stopping container istio-proxy 92s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-7f694df8bc from 9 to 1 92s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x Stopping container istio-proxy 92s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k Stopping container istio-proxy 92s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-dtz5k 92s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-f7ssq Stopping container istio-proxy 92s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 1; reason: All metrics below target 92s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-lwsc9 Stopping container istio-proxy 92s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-f7ssq 92s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-7f694df8bc Deleted pod: maas-default-gateway-openshift-default-7f694df8bc-qxjl4 91s Normal Killing pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx Stopping container istio-proxy